-- Logs begin at Fri 2022-10-28 08:59:52 UTC, end at Fri 2022-10-28 11:07:33 UTC. -- Oct 28 09:34:22.660685 dv-neutron-zed-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 09:34:22.669938 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 09:34:22.672564 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 09:34:22 2022] *** Oct 28 09:34:22.672703 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:34:22.672816 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:34:22.672919 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: nodename: dv-neutron-zed-2-hyperv Oct 28 09:34:22.673013 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: machine: x86_64 Oct 28 09:34:22.673121 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: clock source: unix Oct 28 09:34:22.673221 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: pcre jit disabled Oct 28 09:34:22.673320 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: detected number of CPU cores: 4 Oct 28 09:34:22.673419 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: current working directory: / Oct 28 09:34:22.673524 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:34:22.673646 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: your processes number limit is 47680 Oct 28 09:34:22.673646 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: your memory page size is 4096 bytes Oct 28 09:34:22.673646 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: detected max file descriptor number: 2048 Oct 28 09:34:22.673646 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: lock engine: pthread robust mutexes Oct 28 09:34:22.673918 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: thunder lock: enabled Oct 28 09:34:22.673981 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 09:34:22.674046 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 09:34:22.713722 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: Python main interpreter initialized at 0x556697a4f9c0 Oct 28 09:34:22.713722 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: python threads support enabled Oct 28 09:34:22.713722 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: your server socket listen backlog is limited to 100 connections Oct 28 09:34:22.713722 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:34:22.714083 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:34:22.714212 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: *** Operational MODE: preforking *** Oct 28 09:34:22.714448 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:34:22.714448 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: spawned uWSGI master process (pid: 88549) Oct 28 09:34:22.714636 dv-neutron-zed-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Oct 28 09:34:22.715608 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: spawned uWSGI worker 1 (pid: 88564, cores: 1) Oct 28 09:34:22.715608 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: spawned uWSGI worker 2 (pid: 88565, cores: 1) Oct 28 09:34:22.716930 dv-neutron-zed-2-hyperv devstack@keystone.service[88549]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:34:27.012607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:34:27.012607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: from cryptography.utils import int_from_bytes Oct 28 09:34:27.013348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:34:27.013348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: from cryptography.utils import int_from_bytes Oct 28 09:34:27.013685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:34:27.013685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: from cryptography.utils import int_from_bytes Oct 28 09:34:27.014142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:34:27.014142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: from cryptography.utils import int_from_bytes Oct 28 09:34:27.063090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:34:27.063263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:34:27.063454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] command line args: [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:34:27.063553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:34:27.063711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:34:27.063794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:34:27.063871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ================================================================================ {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:34:27.063941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] command line args: [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:34:27.064118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] admin_token = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.064204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:34:27.064312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ================================================================================ {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:34:27.064389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] config_dir = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.064530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.064607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] admin_token = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.064713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] config_source = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.064798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] config_dir = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.064875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] debug = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.064951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] config_source = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] debug = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.065941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] list_limit = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] log_config_append = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] list_limit = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] log_config_append = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.066973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] log_dir = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] log_file = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] log_dir = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] log_file = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067679 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.067943 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068807 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.068880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.069024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.069637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.069830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.069911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070737 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.070977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.071249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.071337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.071460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] publish_errors = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.071678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.071754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.071894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] publish_errors = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] standard_threads = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.072961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] standard_threads = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] use_journal = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] use_json = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] use_stderr = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.073976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] use_journal = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.074053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] use_syslog = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.074167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] use_json = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.074240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.074344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] use_stderr = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.074530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.074681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] use_syslog = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.074799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.074873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:34:27.074942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.075950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.076898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.077856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.078816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.080702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.080807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.080807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.080979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.081977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.082947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.083950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.084951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.085881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.086979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.087967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.088899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.089926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.090915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.091856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.092856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.093923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.094962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.095886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.096950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.097923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.098905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] auth.external = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] auth.external = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.099850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.100036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.100288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] auth.password = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.100364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.100514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] auth.token = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.100592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.100786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.100880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] auth.password = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] auth.token = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.101985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.102062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.102211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.102289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.102443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] credential.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.102521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.102713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.102796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.107954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] credential.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.108978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.109998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.110951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.111943 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.112946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.113938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114771 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.114996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.115716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.116991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.117990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.118142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.118220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.118368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.118447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.118600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.118783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.118864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.119997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.120949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.121882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.122854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.123926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.124931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.125872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.126973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.127976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.128903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.129976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.130924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.131015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.131157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.131234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.131413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] role.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] role.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.132974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] role.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] role.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.133922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.134931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.135055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.138873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.139952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140780 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.140994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.141996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.142939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.143975 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.144875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.connection = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.145985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.connection = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146296 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.146925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.147964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148842 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.148922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.149080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.149159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.149308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.149388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.149481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:34:27.149559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.149755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.149990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.150218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:34:27.150383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88565) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:34:27.184836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.185060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.185145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.185315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.185429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.185543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.193634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.193903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.226198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.226423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.226900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.227130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.290957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.291108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.338824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.339055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.339620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.339857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.505093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.505402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.505555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.505648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.505782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.505867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.505994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.506076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.506205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.506286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.506443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.506662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.528892 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.529121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.529340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.529425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.529800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.529906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.530942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.545340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.545460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.558964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.559046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.559176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.559270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.559387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.559469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88565) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.559604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 09:34:27.576557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.576683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.576765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:34:27.576839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:34:27.577089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.577172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.577286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:34:27.577379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 09:34:27.577557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.577639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.577816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.577898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.578069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.578159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.578317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.578399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.588006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.588104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.591499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.591578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.591640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.591700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.591760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.591833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.595759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.595883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.598760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.598861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.599014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.599111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.599291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.599372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.599567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.599649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.599849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.599932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.600612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.600700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.600884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.600975 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.601154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.601236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.601416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.601495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.601683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.601772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.601946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.602027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.625057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.625484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.626510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.626818 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.627020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.627302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.631537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.631818 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.632095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.632178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.632376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.632651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.638404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.638705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.639021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.639303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.644298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.644593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.644873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.644957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.645150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.645233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.645424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.645516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.645696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.645778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.645965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.646046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.646229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.646319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.646490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.646779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.662399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.662752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.663774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.664044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.667178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.667940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.670388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.670707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.671143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.671431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.674904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.675661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.677993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.679058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.682524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.682524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.682524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.682783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.682869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.682937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.682999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.683061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.683123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.683194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.683194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.683778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.698475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.698856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.699123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.699337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.699432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.699676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.700219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.700484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.706192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.707751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.707910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.709269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.709437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.710061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.711532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.711802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.712719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.713020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.713300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.713578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.713975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.714647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.714946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.715223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.715500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.715897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.725106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.725904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.726186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.726465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.726865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.727152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.727426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.727620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.727899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.728175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.728451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.728821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.729092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.729373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.742809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.744750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.745689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.747725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.748597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.750024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.750642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.751552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.751834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.752082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.752228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.753541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.753819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.754214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.758580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.760052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.760639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.762088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.762942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.763339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.763626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.763903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.765010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.765395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.765679 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.765946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.771704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.772541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.772823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.774369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.774657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.774950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.780032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.780314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.780591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.780862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.781130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.781407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.781683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.781955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.782096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88565) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 09:34:27.782221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.782373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.782513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.782646 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.782809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.782934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.783068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.783202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.783339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.783467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.783606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.783733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.784040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.784308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.784584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.784858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.785113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.785369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.785634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88565) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 09:34:27.817913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556697a4f9c0 pid: 88564 (default app) Oct 28 09:34:27.821280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435045-78a9-4fbe-a1c5-cb58eb4b58b9 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:27.821476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556697a4f9c0 pid: 88565 (default app) Oct 28 09:34:27.821566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435045-78a9-4fbe-a1c5-cb58eb4b58b9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:27.821827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46435045-78a9-4fbe-a1c5-cb58eb4b58b9 None None] PATH_INFO: `/v3` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:27.825941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Fri Oct 28 09:34:27 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:35.454322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526710-fe56-49ef-b0e8-72ad2e2bef58 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.454857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526710-fe56-49ef-b0e8-72ad2e2bef58 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.454939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89526710-fe56-49ef-b0e8-72ad2e2bef58 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.459735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:35.464867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:35.465313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:35.465408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:35.534934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: INFO dbcounter [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] Registered counter for database keystone Oct 28 09:34:35.554013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG oslo_db.sqlalchemy.engines [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:34:35.560141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writer thread running {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:34:35.736556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG passlib.handlers.bcrypt [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88564) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 09:34:35.736874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG passlib.handlers.bcrypt [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88564) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 09:34:35.794883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:35.796474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:35.921954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 09:34:36.400267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526710-fe56-49ef-b0e8-72ad2e2bef58 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.469503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: INFO dbcounter [None req-89526710-fe56-49ef-b0e8-72ad2e2bef58 None None] Registered counter for database keystone Oct 28 09:34:36.491666 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG oslo_db.sqlalchemy.engines [None req-89526710-fe56-49ef-b0e8-72ad2e2bef58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88565) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:34:36.497713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writer thread running {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:34:36.614568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89526710-fe56-49ef-b0e8-72ad2e2bef58 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.618843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8f80f-f00a-4857-a58d-56aec0c8e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.619462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f80f-f00a-4857-a58d-56aec0c8e95a admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.619740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f80f-f00a-4857-a58d-56aec0c8e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.620009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8f80f-f00a-4857-a58d-56aec0c8e95a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.627997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8f80f-f00a-4857-a58d-56aec0c8e95a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.680731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c4e8f80f-f00a-4857-a58d-56aec0c8e95a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 09:34:36.681032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8f80f-f00a-4857-a58d-56aec0c8e95a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.690531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 09:34:36.697169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:36.713506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85602f-3566-40ed-aaea-bfcbbb4ee7fd None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:36.717957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba138b0-0a3f-4e49-acda-190c0c99acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:36.719065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba138b0-0a3f-4e49-acda-190c0c99acfb admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:36.719341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba138b0-0a3f-4e49-acda-190c0c99acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:36.719606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba138b0-0a3f-4e49-acda-190c0c99acfb admin admin] PATH_INFO: `/v3/projects/713caf85a4104b85af4a0b40b1b96328` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:36.721146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba138b0-0a3f-4e49-acda-190c0c99acfb admin admin] RBAC: Authorizing `identity:get_project(project_id=713caf85a4104b85af4a0b40b1b96328)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:36.773730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8ba138b0-0a3f-4e49-acda-190c0c99acfb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 09:34:36.774076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba138b0-0a3f-4e49-acda-190c0c99acfb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:36.778468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Fri Oct 28 09:34:36 2022] GET /identity/v3/projects/713caf85a4104b85af4a0b40b1b96328 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:38.870650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4900-beba-4afe-950b-fedffbe54efb None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.871188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4900-beba-4afe-950b-fedffbe54efb None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.871267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b4900-beba-4afe-950b-fedffbe54efb None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.875283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:38.881115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f9fc-bd03-46f0-9a42-4aa3ceeead00 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:38.881584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f9fc-bd03-46f0-9a42-4aa3ceeead00 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:38.881670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f9fc-bd03-46f0-9a42-4aa3ceeead00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:38.901881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-3f66f9fc-bd03-46f0-9a42-4aa3ceeead00 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:38.903406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3f66f9fc-bd03-46f0-9a42-4aa3ceeead00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:38.911401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 09:34:39.177910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b4900-beba-4afe-950b-fedffbe54efb None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:39.189925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b4900-beba-4afe-950b-fedffbe54efb None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:39.194219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb675ac8-f02d-4614-a3c3-dc37b9130650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:39.194849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675ac8-f02d-4614-a3c3-dc37b9130650 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.195130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675ac8-f02d-4614-a3c3-dc37b9130650 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.195401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb675ac8-f02d-4614-a3c3-dc37b9130650 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.202913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675ac8-f02d-4614-a3c3-dc37b9130650 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:39.204697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb675ac8-f02d-4614-a3c3-dc37b9130650 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:39.213798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:34:39.218908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f9fc-bd03-46f0-9a42-4aa3ceeead00 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:39.228533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f9fc-bd03-46f0-9a42-4aa3ceeead00 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:39.232748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7cce3-f168-4df9-9142-63119814948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:39.233359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7cce3-f168-4df9-9142-63119814948b admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:39.233635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7cce3-f168-4df9-9142-63119814948b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:39.233903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7cce3-f168-4df9-9142-63119814948b admin admin] PATH_INFO: `/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:39.235226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7cce3-f168-4df9-9142-63119814948b admin admin] RBAC: Authorizing `identity:get_user(user_id=6fcd63f0bb4e43ce8c0c41898fafca96)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:39.237028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7cce3-f168-4df9-9142-63119814948b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:39.238507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Fri Oct 28 09:34:39 2022] GET /identity/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:41.417380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3026-dd43-4a3f-94ff-1baeac3f9684 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.417938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3026-dd43-4a3f-94ff-1baeac3f9684 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.417938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3026-dd43-4a3f-94ff-1baeac3f9684 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.419258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:41.424476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bc19d-861a-4842-8b33-e1960a2fb503 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.424919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bc19d-861a-4842-8b33-e1960a2fb503 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.425013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bc19d-861a-4842-8b33-e1960a2fb503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.443737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-398bc19d-861a-4842-8b33-e1960a2fb503 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:41.444928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-398bc19d-861a-4842-8b33-e1960a2fb503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:41.457734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1525ba7-6b72-4e50-9469-d06fad8b43fa None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.458021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1525ba7-6b72-4e50-9469-d06fad8b43fa None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.458294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1525ba7-6b72-4e50-9469-d06fad8b43fa None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.460229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:41.465224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.465512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.465781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.507037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG passlib.handlers.bcrypt [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88565) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 09:34:41.507437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG passlib.handlers.bcrypt [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88565) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 09:34:41.526492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:41.556936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:41.558513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:41.659046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:41.792453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bc19d-861a-4842-8b33-e1960a2fb503 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.816794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:41.894095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bc19d-861a-4842-8b33-e1960a2fb503 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:41.921513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:41.934530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:41.935145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:41.935424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:41.935699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:41.948262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:41.957146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:41.958197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:34:41.959541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:41.963924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.023385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc8201-d95a-4ce0-ab62-0409fd51e0d8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.026600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.044800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.060782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.062789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.062789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.062789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.063105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a9aaf-03f1-43dd-bb10-ff5aff9ea210 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.095262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.105666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.105666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.105666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.105666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:42.105666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.105666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.110241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:42.116339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.129544 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.131749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.216020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d4ca2-6f5b-46ac-a6e6-b475a5f0fd76 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.230381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:34:42.235936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.239057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.251444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.252093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.256182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.256182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] PATH_INFO: `/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.256182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd63f0bb4e43ce8c0c41898fafca96)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.256182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.257604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:42.262953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.277168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.334279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42b07-2856-4f50-bc4b-3933d450fa9e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.360960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e3086-d86a-485f-b1bc-eca7d4ed1f02 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.371335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.372193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.372478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.372752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.391164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.392667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.394454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.395116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.395391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.395662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.396793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.398213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.399917 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:42.405853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:42.411456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:42.413018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:42.414036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:42.414036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:42.414036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:34:42.414036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:42.419156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:42.475656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.487361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:42.506927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179250f-a90c-4ae6-9c07-af64850cd9b1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.520546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4b0cd-827f-4c76-894c-92dc24083f82 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:42.540277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c42e7-760b-45ce-98e4-60d0527dd953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.540882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c42e7-760b-45ce-98e4-60d0527dd953 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.541162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c42e7-760b-45ce-98e4-60d0527dd953 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.541436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c42e7-760b-45ce-98e4-60d0527dd953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.542162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c42e7-760b-45ce-98e4-60d0527dd953 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.domain.id=default, user.id=6fcd63f0bb4e43ce8c0c41898fafca96) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:42.542465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c42e7-760b-45ce-98e4-60d0527dd953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.543939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c42e7-760b-45ce-98e4-60d0527dd953 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.550527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/role_assignments?user.id=6fcd63f0bb4e43ce8c0c41898fafca96&scope.domain.id=default&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:42.554977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4f271-8c11-4ad9-9cc5-8645a6721522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:42.555594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4f271-8c11-4ad9-9cc5-8645a6721522 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:42.555866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4f271-8c11-4ad9-9cc5-8645a6721522 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:42.556131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4f271-8c11-4ad9-9cc5-8645a6721522 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:42.556904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4f271-8c11-4ad9-9cc5-8645a6721522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:42.557159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4f271-8c11-4ad9-9cc5-8645a6721522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:42.558583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4f271-8c11-4ad9-9cc5-8645a6721522 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:42.578135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:45.221319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90867053-1d1a-4bc2-bf62-198a95aec369 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.222158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90867053-1d1a-4bc2-bf62-198a95aec369 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.222592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90867053-1d1a-4bc2-bf62-198a95aec369 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.224748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:45.238718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c4ad8-4021-447f-bc19-714925b57e1a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.239243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c4ad8-4021-447f-bc19-714925b57e1a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.239466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c4ad8-4021-447f-bc19-714925b57e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.267817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-5a0c4ad8-4021-447f-bc19-714925b57e1a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:45.269063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5a0c4ad8-4021-447f-bc19-714925b57e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:45.360509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:45.373183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31b60-e123-415b-9e43-46c374254dbd None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.373755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31b60-e123-415b-9e43-46c374254dbd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.374257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31b60-e123-415b-9e43-46c374254dbd None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.375846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:45.381173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d734e8-4f78-47a9-a2f8-b16fe3a502ca None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.381460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d734e8-4f78-47a9-a2f8-b16fe3a502ca None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.381731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d734e8-4f78-47a9-a2f8-b16fe3a502ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.387227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f749f-3347-4e70-8bc0-f1e8779ffd11 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.387744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f749f-3347-4e70-8bc0-f1e8779ffd11 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.388298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f749f-3347-4e70-8bc0-f1e8779ffd11 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.389866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 14/25] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:45.396266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634af8-c86b-40a1-a1b1-a4ac0117f783 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.396809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634af8-c86b-40a1-a1b1-a4ac0117f783 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.397292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4634af8-c86b-40a1-a1b1-a4ac0117f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.415688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-18d734e8-4f78-47a9-a2f8-b16fe3a502ca None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:45.416875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-18d734e8-4f78-47a9-a2f8-b16fe3a502ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:45.422301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e4634af8-c86b-40a1-a1b1-a4ac0117f783 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:45.423786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e4634af8-c86b-40a1-a1b1-a4ac0117f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:45.500506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.555784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 15/26] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:45.570987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 12/27] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:45.729968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4634af8-c86b-40a1-a1b1-a4ac0117f783 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:45.815279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:45.847124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4634af8-c86b-40a1-a1b1-a4ac0117f783 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:45.891992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:45.892688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.892983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.893252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.893918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:45.895338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:45.919903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93da11b-c85c-4aea-b369-9140b9e926e0 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.922995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93da11b-c85c-4aea-b369-9140b9e926e0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.922995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93da11b-c85c-4aea-b369-9140b9e926e0 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.922995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 13/28] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:45.927375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a481-6954-4a1c-8a19-155ef027fd9e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:45.927655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a481-6954-4a1c-8a19-155ef027fd9e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:45.927927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a481-6954-4a1c-8a19-155ef027fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:45.955627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7fc7a481-6954-4a1c-8a19-155ef027fd9e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:45.956826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7fc7a481-6954-4a1c-8a19-155ef027fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:46.064364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 14/29] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:46.065416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a481-6954-4a1c-8a19-155ef027fd9e None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.207316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a481-6954-4a1c-8a19-155ef027fd9e None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.219332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.238950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 16/30] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 09:34:45 2022] POST /identity/v3/roles => generated 219 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:46.240326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.263299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.263953 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.264230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.264497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.303796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:46.311074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:46.311982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:34:46.312728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 15/31] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:46.324652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.458727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c1928-adbb-43ff-b197-dcdc9b16d9a5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.498424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfee884-38a0-4404-bd3f-b1773ca998a3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.503401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702421a-3182-45a7-98be-44a2f956c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.504336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702421a-3182-45a7-98be-44a2f956c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.504829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702421a-3182-45a7-98be-44a2f956c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.505339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702421a-3182-45a7-98be-44a2f956c5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.508365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.519391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702421a-3182-45a7-98be-44a2f956c5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.522401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702421a-3182-45a7-98be-44a2f956c5e6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.543109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.543825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.544199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.545039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.546448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:46.546816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-4702421a-3182-45a7-98be-44a2f956c5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:34:46.546997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:46.547784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:34:46.548578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:34:46.548578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:34:46.548578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:34:46.548578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 17/32] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:46.548784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.549557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e6de-0bf5-427a-97d3-bf7fec36aa5f None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.549655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e6de-0bf5-427a-97d3-bf7fec36aa5f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.550605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e6de-0bf5-427a-97d3-bf7fec36aa5f None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.551523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 18/33] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:46.552860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336e6de-0bf5-427a-97d3-bf7fec36aa5f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.562590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 16/34] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:46.563468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.595946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.682493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336e6de-0bf5-427a-97d3-bf7fec36aa5f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.683386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb65ce-7c0d-45fc-9866-6d98ab76ac86 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:46.718495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c2cdf-18ac-4622-8d76-64c2647d6eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.719127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c2cdf-18ac-4622-8d76-64c2647d6eaf None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.719404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c2cdf-18ac-4622-8d76-64c2647d6eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.719675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c2cdf-18ac-4622-8d76-64c2647d6eaf None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.720311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c2cdf-18ac-4622-8d76-64c2647d6eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:46.720610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c2cdf-18ac-4622-8d76-64c2647d6eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.721970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c2cdf-18ac-4622-8d76-64c2647d6eaf None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.726390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:46.727029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.727310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.727578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.728276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:46.730735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:46.738137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 17/35] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:46.738137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361aea2-3a0f-4bcd-842e-37968881db69 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:46.738137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361aea2-3a0f-4bcd-842e-37968881db69 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:46.738137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361aea2-3a0f-4bcd-842e-37968881db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:46.753362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6361aea2-3a0f-4bcd-842e-37968881db69 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:46.754542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6361aea2-3a0f-4bcd-842e-37968881db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:46.815351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 19/36] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 09:34:46 2022] POST /identity/v3/roles => generated 225 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:46.818377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.826283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 18/37] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:46.832759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361aea2-3a0f-4bcd-842e-37968881db69 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:46.875580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:46.924890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.009924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948dcfe-f06e-4c4c-8fee-5b57a5d0f79b None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.022906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361aea2-3a0f-4bcd-842e-37968881db69 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.047567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f950e-ca5c-4896-ac0e-b69e9be06f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.048210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f950e-ca5c-4896-ac0e-b69e9be06f28 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.048495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f950e-ca5c-4896-ac0e-b69e9be06f28 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.048767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f950e-ca5c-4896-ac0e-b69e9be06f28 None admin] PATH_INFO: `/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.049906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f950e-ca5c-4896-ac0e-b69e9be06f28 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd63f0bb4e43ce8c0c41898fafca96)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.051409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f950e-ca5c-4896-ac0e-b69e9be06f28 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.053597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:46 2022] GET /identity/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96 => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:47.054849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc162459-9734-4cfe-a129-11d010909cd6 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.055265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc162459-9734-4cfe-a129-11d010909cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.055543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc162459-9734-4cfe-a129-11d010909cd6 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.056738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 21/39] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:47.060730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc162459-9734-4cfe-a129-11d010909cd6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.066236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77504a34-7230-4315-aeab-f6273dedad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.066893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504a34-7230-4315-aeab-f6273dedad70 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.067173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504a34-7230-4315-aeab-f6273dedad70 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.067447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504a34-7230-4315-aeab-f6273dedad70 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.068489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504a34-7230-4315-aeab-f6273dedad70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.069868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77504a34-7230-4315-aeab-f6273dedad70 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.271166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc162459-9734-4cfe-a129-11d010909cd6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.279419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 19/40] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:46 2022] POST /identity/v3/projects => generated 301 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:47.280950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245420f-773f-490c-8caf-a8bdfac92104 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.281246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245420f-773f-490c-8caf-a8bdfac92104 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.281525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245420f-773f-490c-8caf-a8bdfac92104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.302002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e245420f-773f-490c-8caf-a8bdfac92104 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:47.303609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e245420f-773f-490c-8caf-a8bdfac92104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:47.305487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.327423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.328145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.328430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.328703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.329882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.331410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.333791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 22/41] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:47.334436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.383497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.398697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 20/42] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:47.398697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245420f-773f-490c-8caf-a8bdfac92104 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.465810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee258ba-905a-4655-be36-61d65541e1a2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.512553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.512553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.512553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.512553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.515751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.535142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245420f-773f-490c-8caf-a8bdfac92104 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.571161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.571825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.572106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.572381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] PATH_INFO: `/v3/domains/default/users/6fcd63f0bb4e43ce8c0c41898fafca96/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.574604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6fcd63f0bb4e43ce8c0c41898fafca96, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.576215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.581506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 23/43] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 09:34:47 2022] POST /identity/v3/roles => generated 223 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:47.654508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 21/44] 10.222.0.49 () {58 vars in 1361 bytes} [Fri Oct 28 09:34:47 2022] PUT /identity/v3/domains/default/users/6fcd63f0bb4e43ce8c0c41898fafca96/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:34:47.684848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.739963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.807308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16701e3-1458-46dd-91d1-06b7bece59fb None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.847154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a93d5b-31a3-44cc-a0a5-21db0dc7a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.847799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93d5b-31a3-44cc-a0a5-21db0dc7a36b None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.848083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93d5b-31a3-44cc-a0a5-21db0dc7a36b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.848361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a93d5b-31a3-44cc-a0a5-21db0dc7a36b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.849539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a93d5b-31a3-44cc-a0a5-21db0dc7a36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.851068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a93d5b-31a3-44cc-a0a5-21db0dc7a36b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:47.852643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 24/45] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:47.858617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:47.917644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:47.958395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9d6c-192b-40c1-bd70-b161791f7bed None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:47.991772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1303b66-9251-44a2-a689-b27309de49dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:47.992374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1303b66-9251-44a2-a689-b27309de49dc None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:47.992708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1303b66-9251-44a2-a689-b27309de49dc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:47.992977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1303b66-9251-44a2-a689-b27309de49dc None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:47.993647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1303b66-9251-44a2-a689-b27309de49dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:47.995165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1303b66-9251-44a2-a689-b27309de49dc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:48.072609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:34:47 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:49.798633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3b35-6fdf-4bb9-8769-2e80d43dc524 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:49.799162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3b35-6fdf-4bb9-8769-2e80d43dc524 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:49.799244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3b35-6fdf-4bb9-8769-2e80d43dc524 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:49.800546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:49.805839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b623a-8dcb-47a6-b154-ed0f47226ef6 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:49.806269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b623a-8dcb-47a6-b154-ed0f47226ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:49.806393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b623a-8dcb-47a6-b154-ed0f47226ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:49.824641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f67b623a-8dcb-47a6-b154-ed0f47226ef6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:49.825812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f67b623a-8dcb-47a6-b154-ed0f47226ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:49.890251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:50.158363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3b35-6fdf-4bb9-8769-2e80d43dc524 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.198411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c12393-4bde-40e7-b514-ce4e415da359 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.198730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c12393-4bde-40e7-b514-ce4e415da359 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.199006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c12393-4bde-40e7-b514-ce4e415da359 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.200903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 24/49] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:50.205430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194213a-ff5d-44d7-a378-f641a1870c30 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.205745 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194213a-ff5d-44d7-a378-f641a1870c30 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.206023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194213a-ff5d-44d7-a378-f641a1870c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.224171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0194213a-ff5d-44d7-a378-f641a1870c30 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:50.225362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0194213a-ff5d-44d7-a378-f641a1870c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:50.261483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:50.262804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3b35-6fdf-4bb9-8769-2e80d43dc524 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.273195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:50.292002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 25/50] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:50.295754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.296382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.296691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.296965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.307810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:50.312624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:50.313455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:34:50.314199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 26/51] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:50.320125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194213a-ff5d-44d7-a378-f641a1870c30 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.414977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194213a-ff5d-44d7-a378-f641a1870c30 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.552306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.552939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.553263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.553538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.554196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:50.554497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:50.555891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:50.560998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.564036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:50.570009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.602809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:50.660798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4353520-93f7-4ee4-b1e0-94395c06d000 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.674713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fbb4b-0b48-41a4-80b9-7214e4264a74 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.698134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.698803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.699088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.699361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.700463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:50.701923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:50.703523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:50.709623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.720173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.721097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.721569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.722031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] PATH_INFO: `/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.723374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd63f0bb4e43ce8c0c41898fafca96)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:50.725221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:50.727735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 27/54] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:50.733460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.758019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:50.824754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fceb82-a784-45d8-80a1-cce3aa6344c2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.844821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a5b4d-1e11-49dd-be2f-c9204df2a70e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:50.846338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:50.861700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007480a-2c53-47bb-848a-37d00f8bc930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.862507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007480a-2c53-47bb-848a-37d00f8bc930 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.862988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007480a-2c53-47bb-848a-37d00f8bc930 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.863263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007480a-2c53-47bb-848a-37d00f8bc930 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.863915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007480a-2c53-47bb-848a-37d00f8bc930 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:50.865449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007480a-2c53-47bb-848a-37d00f8bc930 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:50.880376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:50.881008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:50.881291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:50.881562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:50.882708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:50.884129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:50.886005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:50.891970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:50.983982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 28/56] 10.222.0.49 () {60 vars in 1140 bytes} [Fri Oct 28 09:34:50 2022] POST /identity/v3/projects => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:34:50.991567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872d0f5-644c-4606-b137-f70007973978 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:51.029102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2021e-4bba-4a15-82c8-6f46018ea609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:51.029719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2021e-4bba-4a15-82c8-6f46018ea609 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:51.029998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2021e-4bba-4a15-82c8-6f46018ea609 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:51.030274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2021e-4bba-4a15-82c8-6f46018ea609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:51.031048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2021e-4bba-4a15-82c8-6f46018ea609 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.domain.id=default, user.id=6fcd63f0bb4e43ce8c0c41898fafca96) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:51.031357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2021e-4bba-4a15-82c8-6f46018ea609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:51.032810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2021e-4bba-4a15-82c8-6f46018ea609 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:51.042310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1322 bytes} [Fri Oct 28 09:34:50 2022] GET /identity/v3/role_assignments?user.id=6fcd63f0bb4e43ce8c0c41898fafca96&scope.domain.id=default&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:34:53.115049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17aa3d-e14e-4a96-a724-e7ec3ab0cab0 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.115556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17aa3d-e14e-4a96-a724-e7ec3ab0cab0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.115638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17aa3d-e14e-4a96-a724-e7ec3ab0cab0 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.116973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:53.122257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3ba0-ce4a-468b-81f9-1ba5364397e1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.122629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3ba0-ce4a-468b-81f9-1ba5364397e1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.122840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3ba0-ce4a-468b-81f9-1ba5364397e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.141217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-21da3ba0-ce4a-468b-81f9-1ba5364397e1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:53.142421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-21da3ba0-ce4a-468b-81f9-1ba5364397e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:53.168914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.208275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:53.476079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17aa3d-e14e-4a96-a724-e7ec3ab0cab0 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.566806 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:53.576891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17aa3d-e14e-4a96-a724-e7ec3ab0cab0 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.609710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883667c2-25c7-4a90-a9db-9be62bdf1b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.610333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883667c2-25c7-4a90-a9db-9be62bdf1b20 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.610613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883667c2-25c7-4a90-a9db-9be62bdf1b20 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.610917 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883667c2-25c7-4a90-a9db-9be62bdf1b20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.612016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883667c2-25c7-4a90-a9db-9be62bdf1b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.613484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883667c2-25c7-4a90-a9db-9be62bdf1b20 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.615639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:53.621225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da3ba0-ce4a-468b-81f9-1ba5364397e1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:53.715823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da3ba0-ce4a-468b-81f9-1ba5364397e1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:53.749313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd24e0-8e42-4a0c-bf06-ec46a6f3235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:53.749853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd24e0-8e42-4a0c-bf06-ec46a6f3235f None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:53.750134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd24e0-8e42-4a0c-bf06-ec46a6f3235f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:53.750406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd24e0-8e42-4a0c-bf06-ec46a6f3235f None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:53.751079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd24e0-8e42-4a0c-bf06-ec46a6f3235f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:53.752522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd24e0-8e42-4a0c-bf06-ec46a6f3235f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:53.839221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:53 2022] POST /identity/v3/users => generated 275 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:57.018849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb897f-9492-47c7-92be-4210b7cb2294 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.019833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb897f-9492-47c7-92be-4210b7cb2294 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.020842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb897f-9492-47c7-92be-4210b7cb2294 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.022387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:57.027908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3fd9-1631-487a-a6a9-13722d763b73 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.028952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3fd9-1631-487a-a6a9-13722d763b73 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.029526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe3fd9-1631-487a-a6a9-13722d763b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.054860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b3fe3fd9-1631-487a-a6a9-13722d763b73 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:57.056340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b3fe3fd9-1631-487a-a6a9-13722d763b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:57.079762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:57.153723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 32/63] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:57.264908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1634e-d52c-4dbf-9654-fbf3bc34d779 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.265532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1634e-d52c-4dbf-9654-fbf3bc34d779 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.266044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1634e-d52c-4dbf-9654-fbf3bc34d779 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.267952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 32/64] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:57.268052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b8eb-68e9-4a45-be62-4db426053b87 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.268305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b8eb-68e9-4a45-be62-4db426053b87 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.268581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4b8eb-68e9-4a45-be62-4db426053b87 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.270875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 33/65] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:57.273176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848813d-b8a8-42b4-a0e4-234791d156d3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.273662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848813d-b8a8-42b4-a0e4-234791d156d3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.274130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848813d-b8a8-42b4-a0e4-234791d156d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.275941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322014-6cb5-4258-82f4-58438fef40dd None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.276224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322014-6cb5-4258-82f4-58438fef40dd None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.276704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa322014-6cb5-4258-82f4-58438fef40dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.307898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fa322014-6cb5-4258-82f4-58438fef40dd None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:57.309113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fa322014-6cb5-4258-82f4-58438fef40dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:57.312054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0848813d-b8a8-42b4-a0e4-234791d156d3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:57.313553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0848813d-b8a8-42b4-a0e4-234791d156d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:57.430350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 33/66] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:57.446523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:34:57.501360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848813d-b8a8-42b4-a0e4-234791d156d3 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.623786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:57.641991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848813d-b8a8-42b4-a0e4-234791d156d3 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:57.702510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44114f6d-665c-4ffa-a724-a310bb5ab2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:57.703320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44114f6d-665c-4ffa-a724-a310bb5ab2b7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.703603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44114f6d-665c-4ffa-a724-a310bb5ab2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.703875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44114f6d-665c-4ffa-a724-a310bb5ab2b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.716975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44114f6d-665c-4ffa-a724-a310bb5ab2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-44114f6d-665c-4ffa-a724-a310bb5ab2b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:57.721811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:57.722634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:34:57.723465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 34/68] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:57.731779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa322014-6cb5-4258-82f4-58438fef40dd None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.803242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5f9a-15fd-4670-9e96-1cbe42e97413 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.803535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5f9a-15fd-4670-9e96-1cbe42e97413 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.803886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5f9a-15fd-4670-9e96-1cbe42e97413 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.805230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 35/69] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:34:57.814415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce5f9a-15fd-4670-9e96-1cbe42e97413 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.853184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:57.872838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa322014-6cb5-4258-82f4-58438fef40dd None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:57.906845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490602-f70b-43b4-88aa-f5e422adbfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:57.907385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490602-f70b-43b4-88aa-f5e422adbfe8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.907705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490602-f70b-43b4-88aa-f5e422adbfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.907993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490602-f70b-43b4-88aa-f5e422adbfe8 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.908654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490602-f70b-43b4-88aa-f5e422adbfe8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:57.908956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490602-f70b-43b4-88aa-f5e422adbfe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:57.910350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490602-f70b-43b4-88aa-f5e422adbfe8 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:57.918241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 35/70] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:57.919445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e9ed-73f9-4d84-b8f7-69d7ce55f3fb None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.919730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e9ed-73f9-4d84-b8f7-69d7ce55f3fb None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.920000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e9ed-73f9-4d84-b8f7-69d7ce55f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.926020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce5f9a-15fd-4670-9e96-1cbe42e97413 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:57.937362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1862e9ed-73f9-4d84-b8f7-69d7ce55f3fb None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:57.938536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1862e9ed-73f9-4d84-b8f7-69d7ce55f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:57.960799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:57.961431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:57.961717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:57.961992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:57.972108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:57.976927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:57.977770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:34:57.978553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:34:57.979203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:57.990907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.003258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 36/72] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:58.004511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691176-89ef-4f83-a3b5-235bdee9423c None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.005452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691176-89ef-4f83-a3b5-235bdee9423c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.005736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5691176-89ef-4f83-a3b5-235bdee9423c None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.007237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 37/73] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:34:58.007757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5691176-89ef-4f83-a3b5-235bdee9423c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.085976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eca0c6-90d0-4f50-988a-ca304c178e35 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.086801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.121028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5691176-89ef-4f83-a3b5-235bdee9423c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.124594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.125227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.125509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.125783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.136158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:58.140993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:58.141826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:34:58.142574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 37/74] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:58.143234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.164057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76be9e-4de7-4ffc-b3d2-664788a4acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.164614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76be9e-4de7-4ffc-b3d2-664788a4acfb None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.164898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76be9e-4de7-4ffc-b3d2-664788a4acfb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.165605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76be9e-4de7-4ffc-b3d2-664788a4acfb None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.182244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76be9e-4de7-4ffc-b3d2-664788a4acfb None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.183722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76be9e-4de7-4ffc-b3d2-664788a4acfb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.185502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.186474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9185a4-95e6-4cf0-9add-1f6ab69c0cb1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.186777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9185a4-95e6-4cf0-9add-1f6ab69c0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.187051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9185a4-95e6-4cf0-9add-1f6ab69c0cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.204948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1f9185a4-95e6-4cf0-9add-1f6ab69c0cb1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:34:58.206121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1f9185a4-95e6-4cf0-9add-1f6ab69c0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:34:58.218341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.252612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ab815-b205-4620-8b2f-84b0f90ec2bd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.275029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 39/76] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:34:58.276060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9185a4-95e6-4cf0-9add-1f6ab69c0cb1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.291951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.292556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.292834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.293102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.293760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:58.294061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.295486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.304509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 38/77] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.305118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.353557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.402114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9185a4-95e6-4cf0-9add-1f6ab69c0cb1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.406226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849ac37-70e3-4833-a7a5-c80c6b22c024 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.438181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.440894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.441511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.441793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.442086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.442781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:58.443086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.444483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.445557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.446316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.446773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.447051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.452799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 40/78] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.453606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.521045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.522532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.559934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9a25c-ddeb-4a33-83da-cab8931db472 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.581746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.593764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.594532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.594834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.594993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.606022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:34:58.610943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:34:58.611971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 41/79] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:34:58.613035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.625573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 39/80] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:58.626756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.656299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.710726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec6f0e-8cc7-42fd-9bad-2552480c458e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.726532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9551be-e601-450f-92de-c13df0f934a0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.744112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.744740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.745024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.745302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] PATH_INFO: `/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.747367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd63f0bb4e43ce8c0c41898fafca96)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.748854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.750457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 42/81] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.751266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.760261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.760885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.761169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.761443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.762561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.764033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.765602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 40/82] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.766364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.804683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.853831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689e37e-f507-4c80-af5e-450af4b741f4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.866120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:58.869880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b57322-9e60-4523-bbd8-878426a56167 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:58.887090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.887714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.887993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.888266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.889367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.890860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.892426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 43/83] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.893194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.904379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:58.904988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:58.905511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:58.905511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:58.906185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:58.906491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:58.907906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:58.916191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 41/84] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:58.916988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:58.992370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507b7d8-f0d5-42d6-b124-bff9591990ec None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.009510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.014449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb04c59-84fe-4c5d-b723-0cad16824b10 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.026309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.026968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.027416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.027692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.029079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.030525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.032164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 44/85] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.032927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.050983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.051619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.051924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.052202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.079063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.118112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.119624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.129122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580dff2-5e4e-4c94-9132-7f5c4763557c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.162277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.162908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.163189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.163458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.215127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 42/86] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:59.215938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.221512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.234862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.236317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.272281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.312710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0a545-61c2-40a2-9c0c-120999fa4573 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.333062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 45/87] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:34:59.333900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.349752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.350355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.350630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.350931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.351569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.353029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.414031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.428439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715bbf-aa4d-4d02-bacb-ec65a44310e6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.445047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 43/88] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:34:59 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:34:59.445947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.465712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.466367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.466644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.467054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.473456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.473456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.473456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 46/89] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.473456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.569097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681e7fe-5d76-4a90-be36-60b7e0b528c0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.589319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.591815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09366f03-d1bf-4a27-b833-859cf5e140a1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.609691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.610316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.610598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.610899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.611678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=ca2aa7b49753487fba927538fa939afc) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:34:59.611993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.613464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.626891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 44/90] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/role_assignments?user.id=ca2aa7b49753487fba927538fa939afc&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=41c7907fa20b41d3a299d45128434e86 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.628164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.635302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.635960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.636301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.636580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.637840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.639502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.641283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 47/91] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.643570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.679201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.778790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591ed78-a264-4e2c-a637-ecb29f663bb3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.810014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447da73-1e8e-4544-b783-d6f76b99b56f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.829051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.830097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.830380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.830660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.832435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.834355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.836220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 45/92] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:34:59.837394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:34:59.854747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:34:59.855334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:34:59.855612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:34:59.855881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:34:59.899685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:34:59.935500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:34:59.937464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:34:59.964166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748edf51-c1c7-4700-8e8b-15ae2e303926 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:34:59.965159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.006115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.007415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.007692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.007963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.008689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=6fcd63f0bb4e43ce8c0c41898fafca96) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:00.008996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.011517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.023909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 46/93] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/role_assignments?user.id=6fcd63f0bb4e43ce8c0c41898fafca96&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:00.024747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.120800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 48/94] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:00.127838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.233954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997abc1-15f1-44a4-906a-21c153dde2c7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.260654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.302051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.303083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.303568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.304179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.305605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] RBAC: Adding query filter params (role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=ca2aa7b49753487fba927538fa939afc) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:00.306102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.312983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.323675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 47/95] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/role_assignments?user.id=ca2aa7b49753487fba927538fa939afc&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:00.374618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7a510-2d32-479b-80b0-0a84f27240c9 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.407615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:00.422374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a85dd5-99cb-4824-9b8e-a677d6c2a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.423064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85dd5-99cb-4824-9b8e-a677d6c2a30f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.423348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85dd5-99cb-4824-9b8e-a677d6c2a30f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.423620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85dd5-99cb-4824-9b8e-a677d6c2a30f None admin] PATH_INFO: `/v3/projects/182e2427c1dd4037969e519cfb144cac` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.424815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a85dd5-99cb-4824-9b8e-a677d6c2a30f None admin] RBAC: Authorizing `identity:get_project(project_id=182e2427c1dd4037969e519cfb144cac)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.426354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a85dd5-99cb-4824-9b8e-a677d6c2a30f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.428607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 49/96] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/projects/182e2427c1dd4037969e519cfb144cac => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:00.434984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:00.577606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4559ed-96d7-43cd-9920-575dcbba17ce None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:00.622975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209599c-b988-458c-a8df-061dadd45a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:00.623988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209599c-b988-458c-a8df-061dadd45a26 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:00.624530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209599c-b988-458c-a8df-061dadd45a26 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:00.625064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209599c-b988-458c-a8df-061dadd45a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:00.626071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209599c-b988-458c-a8df-061dadd45a26 None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=182e2427c1dd4037969e519cfb144cac, user.id=ca2aa7b49753487fba927538fa939afc) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:00.626601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209599c-b988-458c-a8df-061dadd45a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:00.628382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209599c-b988-458c-a8df-061dadd45a26 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:00.639487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 48/97] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:00 2022] GET /identity/v3/role_assignments?user.id=ca2aa7b49753487fba927538fa939afc&scope.project.id=182e2427c1dd4037969e519cfb144cac&role.id=41c7907fa20b41d3a299d45128434e86 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:02.283961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae6fd-0d3b-4d22-adf0-0a79a58514ac None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.284472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae6fd-0d3b-4d22-adf0-0a79a58514ac None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.284544 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae6fd-0d3b-4d22-adf0-0a79a58514ac None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.286028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 50/98] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:02.291512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6572ac-b5f7-455b-ab7c-648a25655bc2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.292369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6572ac-b5f7-455b-ab7c-648a25655bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.292850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6572ac-b5f7-455b-ab7c-648a25655bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.315742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0f6572ac-b5f7-455b-ab7c-648a25655bc2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:02.317571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0f6572ac-b5f7-455b-ab7c-648a25655bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:02.362616 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:02.402647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 49/99] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:02.635970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7ed9-c104-4025-b755-91bd410cd9c9 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.636334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7ed9-c104-4025-b755-91bd410cd9c9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.636530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae7ed9-c104-4025-b755-91bd410cd9c9 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.638021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 51/100] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:02.643106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b0ee-a37d-4e37-8243-7a7205c9e732 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.643400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b0ee-a37d-4e37-8243-7a7205c9e732 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.643736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3b0ee-a37d-4e37-8243-7a7205c9e732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.664621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f536-6699-45f2-8393-29b9f6ebf957 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.664905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f536-6699-45f2-8393-29b9f6ebf957 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.665162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0f536-6699-45f2-8393-29b9f6ebf957 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.666647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 52/101] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:02.668085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cfc3b0ee-a37d-4e37-8243-7a7205c9e732 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:02.669267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cfc3b0ee-a37d-4e37-8243-7a7205c9e732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:02.671396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b8877-637f-404d-ad3c-5f677cd78a8a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:02.671681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b8877-637f-404d-ad3c-5f677cd78a8a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:02.671949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b8877-637f-404d-ad3c-5f677cd78a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:02.701457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-017b8877-637f-404d-ad3c-5f677cd78a8a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:02.702963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-017b8877-637f-404d-ad3c-5f677cd78a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:02.806140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 50/102] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:02.832986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 53/103] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:02.989615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b0ee-a37d-4e37-8243-7a7205c9e732 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.092943 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.095765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3b0ee-a37d-4e37-8243-7a7205c9e732 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.135412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.136083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.138140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.138428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.151891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:03.157045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:03.157958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:03.158727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:03.162801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 51/104] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:03.165020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b8877-637f-404d-ad3c-5f677cd78a8a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.267994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.340748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b8877-637f-404d-ad3c-5f677cd78a8a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.371324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.386716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f8e42-10d2-4431-a69e-e9518f9a5c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.387600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f8e42-10d2-4431-a69e-e9518f9a5c1e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.388055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f8e42-10d2-4431-a69e-e9518f9a5c1e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.388531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f8e42-10d2-4431-a69e-e9518f9a5c1e None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.389563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f8e42-10d2-4431-a69e-e9518f9a5c1e None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:03.390045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f8e42-10d2-4431-a69e-e9518f9a5c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.392261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f8e42-10d2-4431-a69e-e9518f9a5c1e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.403526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 54/105] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:03.405425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3e35-9cc2-4d76-a67c-ada0ceb631d2 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.405915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3e35-9cc2-4d76-a67c-ada0ceb631d2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.406405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e3e35-9cc2-4d76-a67c-ada0ceb631d2 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.407810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 55/106] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:03.408968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e3e35-9cc2-4d76-a67c-ada0ceb631d2 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.415280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dfdf7-694d-43f8-a029-38fb14301f29 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.466402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.467219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.467573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.468170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.469849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.472069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.474191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 52/107] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:03.475145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.514260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.541924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e3e35-9cc2-4d76-a67c-ada0ceb631d2 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.590729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc44bd-52cb-4140-9a33-b084018be941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.591735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc44bd-52cb-4140-9a33-b084018be941 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.591950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc44bd-52cb-4140-9a33-b084018be941 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.592309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc44bd-52cb-4140-9a33-b084018be941 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.601882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4cdbf-03ae-4c00-b979-7d9381a65f9d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.605758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc44bd-52cb-4140-9a33-b084018be941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-82dc44bd-52cb-4140-9a33-b084018be941 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:03.611112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:03.611963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:03.612731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 56/108] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:03.618387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d342-2d76-47dc-88e9-8e20db79c1f8 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.618387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d342-2d76-47dc-88e9-8e20db79c1f8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.618387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383d342-2d76-47dc-88e9-8e20db79c1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.634785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2383d342-2d76-47dc-88e9-8e20db79c1f8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:03.636274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2383d342-2d76-47dc-88e9-8e20db79c1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:03.647795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.650770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.650770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.650770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.650770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.652520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.654625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 53/109] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:03.655579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.677210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.712942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 57/110] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:03.719415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383d342-2d76-47dc-88e9-8e20db79c1f8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.763128 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:03.767059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201c5e5-049f-46bd-abba-c5e5ed82ecd7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.813451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18c6e1-63eb-46ac-99ba-c1eb39462c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.814410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18c6e1-63eb-46ac-99ba-c1eb39462c30 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.814914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18c6e1-63eb-46ac-99ba-c1eb39462c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.815405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18c6e1-63eb-46ac-99ba-c1eb39462c30 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.816254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18c6e1-63eb-46ac-99ba-c1eb39462c30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.818602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18c6e1-63eb-46ac-99ba-c1eb39462c30 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.865523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383d342-2d76-47dc-88e9-8e20db79c1f8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:03.903935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:03.904570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.904853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.905130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.905818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:03.906125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:03.907594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:03.918490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 58/111] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:03.919390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.925297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 54/112] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:35:03 2022] POST /identity/v3/projects => generated 302 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:03.934329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e07c1-55e9-47b2-acbc-b34c060197aa None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:03.934742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e07c1-55e9-47b2-acbc-b34c060197aa None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:03.935810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e07c1-55e9-47b2-acbc-b34c060197aa None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:03.937470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 55/113] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:03.938059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e07c1-55e9-47b2-acbc-b34c060197aa None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:03.981986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.074351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b155d-189e-4fc2-9c30-895d401cc339 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.114782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e07c1-55e9-47b2-acbc-b34c060197aa None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.120371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e4e7-7ee0-4c1c-9155-c5ae528c5fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.121020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e4e7-7ee0-4c1c-9155-c5ae528c5fc1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.121302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e4e7-7ee0-4c1c-9155-c5ae528c5fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.121577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e4e7-7ee0-4c1c-9155-c5ae528c5fc1 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.122852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e4e7-7ee0-4c1c-9155-c5ae528c5fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.124317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11e4e7-7ee0-4c1c-9155-c5ae528c5fc1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.130376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 59/114] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:04.130376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0e56d-caa0-43f3-b359-b0efcb864054 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.130376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0e56d-caa0-43f3-b359-b0efcb864054 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.130376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0e56d-caa0-43f3-b359-b0efcb864054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.147692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-51e0e56d-caa0-43f3-b359-b0efcb864054 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:04.148883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-51e0e56d-caa0-43f3-b359-b0efcb864054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:04.159175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c5ba1-f1e3-43a5-bd34-f1b568915375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.159811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5ba1-f1e3-43a5-bd34-f1b568915375 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.160091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5ba1-f1e3-43a5-bd34-f1b568915375 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.160489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c5ba1-f1e3-43a5-bd34-f1b568915375 None admin] PATH_INFO: `/v3/users/7f6cadb0358b43e99e9de987571d5a50` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.175096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c5ba1-f1e3-43a5-bd34-f1b568915375 None admin] RBAC: Authorizing `identity:get_user(user_id=7f6cadb0358b43e99e9de987571d5a50)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.176699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c5ba1-f1e3-43a5-bd34-f1b568915375 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.178735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 56/115] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:03 2022] GET /identity/v3/users/7f6cadb0358b43e99e9de987571d5a50 => generated 289 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:04.179934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96606d-b9cc-4b04-963b-c6ca7786c55e None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.180219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96606d-b9cc-4b04-963b-c6ca7786c55e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.180495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96606d-b9cc-4b04-963b-c6ca7786c55e None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.181715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 57/116] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:04.182414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96606d-b9cc-4b04-963b-c6ca7786c55e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.191070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.231209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 60/117] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:04.231209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0e56d-caa0-43f3-b359-b0efcb864054 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.267400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.296095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96606d-b9cc-4b04-963b-c6ca7786c55e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.341329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.341882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.342166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.342439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.356811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:04.357319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0e56d-caa0-43f3-b359-b0efcb864054 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:04.363051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:04.364100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 58/118] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:04.369516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.410056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c288c-a729-464b-9143-a727a0af2a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.411316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c288c-a729-464b-9143-a727a0af2a4f None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.412676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c288c-a729-464b-9143-a727a0af2a4f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.413097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c288c-a729-464b-9143-a727a0af2a4f None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/ca2aa7b49753487fba927538fa939afc/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.415287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c288c-a729-464b-9143-a727a0af2a4f None admin] RBAC: Authorizing `identity:create_grant(project_id=34c4b4b91bf74ea59cd59644b04803ed, user_id=ca2aa7b49753487fba927538fa939afc, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.417525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c288c-a729-464b-9143-a727a0af2a4f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.444966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.478843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e06009-a12d-4220-b39d-bd90d460e4b7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.512481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.513091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.513370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.513640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.525541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 61/119] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:04 2022] PUT /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/ca2aa7b49753487fba927538fa939afc/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:04.526932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbccd-27b7-45d4-985b-5a3239db1995 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.527223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbccd-27b7-45d4-985b-5a3239db1995 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.527554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbccd-27b7-45d4-985b-5a3239db1995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.547862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-016dbccd-27b7-45d4-985b-5a3239db1995 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:04.549208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-016dbccd-27b7-45d4-985b-5a3239db1995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:04.602873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.604373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.647733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 62/120] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:04.649705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dbccd-27b7-45d4-985b-5a3239db1995 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.678931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.686046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:04.740563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 59/121] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:04.741408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.796916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dbccd-27b7-45d4-985b-5a3239db1995 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.853999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.854535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.854903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.855176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.855839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:04.856138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:04.857518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:04.874015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 63/122] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:04.875630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:04.879823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3374c5-db9e-4955-9fe4-059635d85bf7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:04.952312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:04.953300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:04.953775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:04.954236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:04.965237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:04.970566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:04.971488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:04.972236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:04.975267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 60/123] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:04.976297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.003149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.006856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.028856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2faa2-729a-48b9-921d-e34c4a02927a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.072863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.073496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.073777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.074048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.075300 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.076865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.078497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 64/124] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.079741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.094798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702ca9e-b20b-4ec1-91d3-550a5b58261c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.143378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.143935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.144206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.144476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] PATH_INFO: `/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.146241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd63f0bb4e43ce8c0c41898fafca96)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.148720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.150292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 61/125] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:04 2022] GET /identity/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.151962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.199551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bb53d-ab1f-4add-8265-bc4c2e82004d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.241724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.242361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.242643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.242940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.258548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:05.265237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:05.266092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:05.266978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 65/126] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:05.267600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.280266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.290083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.290899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198b6a0-4a4d-4ad4-beaa-2505ff8b9fc3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.334872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.336077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.336737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.337152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.338153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:05.338980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.340963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.353669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 62/127] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.354814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.384631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817bcb8-b184-4055-9a2b-6281aead200b None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.424443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.425143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.425524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.425903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.426829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] RBAC: Adding query filter params (role.id=cebc95f212be431ea7e26e82669eefef, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=7f6cadb0358b43e99e9de987571d5a50) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:05.427365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.428986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.435399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 66/128] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/role_assignments?user.id=7f6cadb0358b43e99e9de987571d5a50&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=cebc95f212be431ea7e26e82669eefef => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.436342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.486711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a3c06-f6cc-4480-9847-1b160a885323 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.532810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.534443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.543300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.543300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.543300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.543300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.546361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.546654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 63/129] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.551848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.586019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0faf7b-5aa4-4d7f-bba2-36aeb22a095f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.628944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.634604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.635616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.636090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.636554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.637445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:05.637957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.641625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.664174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 67/130] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.665951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.788659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d744ec8-01d8-4ebe-b483-5b8eefcc19c0 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.828956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.829614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.829891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.830162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/6fcd63f0bb4e43ce8c0c41898fafca96/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.833794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc670-ab7d-4cfb-9970-bf9cffb52b94 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:05.838232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] RBAC: Authorizing `identity:create_grant(project_id=34c4b4b91bf74ea59cd59644b04803ed, user_id=6fcd63f0bb4e43ce8c0c41898fafca96, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.839697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.876740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:05.877427 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:05.877710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:05.877983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:05.879699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:05.881149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:05.883025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 64/131] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:05.883950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:05.963033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:05.968061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 68/132] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:05 2022] PUT /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/6fcd63f0bb4e43ce8c0c41898fafca96/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:05.968917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.016913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.031822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49806d1b-ed92-4b3c-9c6c-207b388979ae None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.092502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.093174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.093540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.093733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.094871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.096333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.098114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 65/133] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:06.103657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.185790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecd639-2ca1-48d7-bd34-238e0ae7b622 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.227007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.227604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.227886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.228164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.228693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291ebe1-d31e-4135-bfb8-31ac1a08497f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.229339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.230967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.232828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 69/134] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:05 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:06.239501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.293319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.293971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.294252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.294526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] PATH_INFO: `/v3/projects/182e2427c1dd4037969e519cfb144cac` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.297352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] RBAC: Authorizing `identity:get_project(project_id=182e2427c1dd4037969e519cfb144cac)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.298874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.300843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 66/135] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/projects/182e2427c1dd4037969e519cfb144cac => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:06.307166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:06.313912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.352836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7538-ee21-4d05-bba8-176ce9b2b86c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.358920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:06.391243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596480f-b15f-4a94-b360-a50237d4fd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.391953 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596480f-b15f-4a94-b360-a50237d4fd47 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.392244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596480f-b15f-4a94-b360-a50237d4fd47 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.392522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596480f-b15f-4a94-b360-a50237d4fd47 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/ca2aa7b49753487fba927538fa939afc/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.395688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596480f-b15f-4a94-b360-a50237d4fd47 None admin] RBAC: Authorizing `identity:create_grant(project_id=34c4b4b91bf74ea59cd59644b04803ed, user_id=ca2aa7b49753487fba927538fa939afc, role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.397138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596480f-b15f-4a94-b360-a50237d4fd47 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.454349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6d77-003f-4c78-b447-80aaac422646 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:06.466853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 70/136] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:06 2022] PUT /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/ca2aa7b49753487fba927538fa939afc/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:06.468406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dbc35-017d-44ef-9ce3-794496db8e24 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.468695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dbc35-017d-44ef-9ce3-794496db8e24 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.469022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967dbc35-017d-44ef-9ce3-794496db8e24 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.470575 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 71/137] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:06.478393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dbddd-4c3b-4b82-b090-49456b0bba58 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.478635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dbddd-4c3b-4b82-b090-49456b0bba58 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.478950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dbddd-4c3b-4b82-b090-49456b0bba58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.519937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-815dbddd-4c3b-4b82-b090-49456b0bba58 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:06.521141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-815dbddd-4c3b-4b82-b090-49456b0bba58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:06.563014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:06.563692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:06.563976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:06.564253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] PATH_INFO: `/v3/projects/182e2427c1dd4037969e519cfb144cac/users/ca2aa7b49753487fba927538fa939afc/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:06.570128 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=182e2427c1dd4037969e519cfb144cac, user_id=ca2aa7b49753487fba927538fa939afc, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:06.571794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:06.648299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 72/138] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:06.660240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 67/139] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:06 2022] PUT /identity/v3/projects/182e2427c1dd4037969e519cfb144cac/users/ca2aa7b49753487fba927538fa939afc/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:06.987845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dbddd-4c3b-4b82-b090-49456b0bba58 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.057827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.107903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dbddd-4c3b-4b82-b090-49456b0bba58 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.156445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc2e3d-d4fa-4470-b2e6-624d40fe06bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.157148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc2e3d-d4fa-4470-b2e6-624d40fe06bb None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.157434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc2e3d-d4fa-4470-b2e6-624d40fe06bb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.157707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc2e3d-d4fa-4470-b2e6-624d40fe06bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.163329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc2e3d-d4fa-4470-b2e6-624d40fe06bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.164807 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc2e3d-d4fa-4470-b2e6-624d40fe06bb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.166756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 73/140] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:07.171844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.182999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b06141-2566-45c9-98dc-7786d1066f5e None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.183281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b06141-2566-45c9-98dc-7786d1066f5e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.183554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b06141-2566-45c9-98dc-7786d1066f5e None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.185158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 74/141] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:07.197289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a76d-0db0-4b5b-a3b2-a94b9a32a376 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.197878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a76d-0db0-4b5b-a3b2-a94b9a32a376 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.198387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288a76d-0db0-4b5b-a3b2-a94b9a32a376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.217747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3288a76d-0db0-4b5b-a3b2-a94b9a32a376 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:07.219330 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3288a76d-0db0-4b5b-a3b2-a94b9a32a376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:07.300288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 75/142] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:07.346300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.359848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b24160-c6f4-4880-b2b2-02a8c4ea1c12 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.397018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.397959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.398516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.398981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.399819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:07.401527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:07.517261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 68/143] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:07 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:07.739464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288a76d-0db0-4b5b-a3b2-a94b9a32a376 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:07.808269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:07.865264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288a76d-0db0-4b5b-a3b2-a94b9a32a376 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:07.905887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:07.906520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:07.906832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:07.907102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:07.918800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:07.923611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:07.924441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:07.925186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:07.930691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 76/144] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:07.932718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.051537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65848a93-4168-4b09-8181-07d5c4590f94 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.092841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.093465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.093796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.094018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.094721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:08.095017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.096424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.106407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 69/145] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.112434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.233467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45ea2c-f876-4b07-b85e-b69fcac4f9dd None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.252346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.276009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7bc67-b847-4e03-b96c-67080635d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.276643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7bc67-b847-4e03-b96c-67080635d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.276916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7bc67-b847-4e03-b96c-67080635d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.277186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7bc67-b847-4e03-b96c-67080635d6e1 None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.281943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7bc67-b847-4e03-b96c-67080635d6e1 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.283508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7bc67-b847-4e03-b96c-67080635d6e1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.286012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 77/146] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.291448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.301353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.425447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dc3be-960c-4fc6-b8fc-eb3dc9a2b728 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.464957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce56fe-7f1b-4b60-a3a8-e757e6ed2414 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.465246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce56fe-7f1b-4b60-a3a8-e757e6ed2414 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.465497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce56fe-7f1b-4b60-a3a8-e757e6ed2414 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.466940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 78/147] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:08.471965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927f98-7406-47a9-8c8d-219e9d061d02 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.472241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927f98-7406-47a9-8c8d-219e9d061d02 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.472508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927f98-7406-47a9-8c8d-219e9d061d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.480437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.481048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.481326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.481600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.498432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2c927f98-7406-47a9-8c8d-219e9d061d02 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:08.499657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2c927f98-7406-47a9-8c8d-219e9d061d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:08.593029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.594528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.607368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.640973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 79/148] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:08.712175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 70/149] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:08.719814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c927f98-7406-47a9-8c8d-219e9d061d02 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:08.843892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c927f98-7406-47a9-8c8d-219e9d061d02 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:08.865609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:08.878176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:08.879349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:08.879641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:08.879906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:08.881169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:08.883523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:08.886257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 80/150] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:08.892072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.003335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729b884-c610-4a42-9fe8-1a2205cd14b6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.013348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.045721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.046331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.046607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.046899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.047682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=ca2aa7b49753487fba927538fa939afc) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.051385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.052855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.060115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 71/151] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:08 2022] GET /identity/v3/role_assignments?user.id=ca2aa7b49753487fba927538fa939afc&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=41c7907fa20b41d3a299d45128434e86 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.109740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.235152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a33c-c139-4e08-95c1-f3e149b606aa None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.282102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.282684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.282963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.283230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.300372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:09.305872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:09.308219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:09.310076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 81/152] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:09.313243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.456290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003e5bb-5603-49c7-bcda-72a5596ea260 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.493593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.494487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.494976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.495414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.496239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:09.496823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.498431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.510701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 72/153] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.516040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.584214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.648042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8727cff-4ca1-4b8c-af4b-dca2b356a096 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.687739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80a720-5493-4bdd-9763-450712433fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.687931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a720-5493-4bdd-9763-450712433fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.688209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a720-5493-4bdd-9763-450712433fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.688477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a720-5493-4bdd-9763-450712433fd3 None admin] PATH_INFO: `/v3/users/7f6cadb0358b43e99e9de987571d5a50` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.689618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80a720-5493-4bdd-9763-450712433fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=7f6cadb0358b43e99e9de987571d5a50)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.691125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80a720-5493-4bdd-9763-450712433fd3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.692952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 82/154] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/users/7f6cadb0358b43e99e9de987571d5a50 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.700485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.742086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:09.836945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6755df-4a50-4902-990e-70be7fdfb010 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:09.843721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4558a-90e0-48c1-8fbc-de941cc8a18f None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.844003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4558a-90e0-48c1-8fbc-de941cc8a18f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.844607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4558a-90e0-48c1-8fbc-de941cc8a18f None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.845646 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 83/155] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:09.853085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a400401-6b92-4999-a1d7-4fdeaf21dcc5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.853393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a400401-6b92-4999-a1d7-4fdeaf21dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.853629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a400401-6b92-4999-a1d7-4fdeaf21dcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.878059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9a400401-6b92-4999-a1d7-4fdeaf21dcc5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:09.879336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9a400401-6b92-4999-a1d7-4fdeaf21dcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:09.911727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:09.912494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:09.912774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:09.913054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:09.915930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:09.917474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:09.922523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 73/156] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:09 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:09.938939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:09.970827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 84/157] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:10.042017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969ae8c-046f-4877-9917-d6c7ea0a0985 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.043152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969ae8c-046f-4877-9917-d6c7ea0a0985 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.043890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969ae8c-046f-4877-9917-d6c7ea0a0985 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.046837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 85/158] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:10.051385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb6d43-0109-4b90-a133-7a69b30c43fd None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.051966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb6d43-0109-4b90-a133-7a69b30c43fd None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.052433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb6d43-0109-4b90-a133-7a69b30c43fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.086250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cbcb6d43-0109-4b90-a133-7a69b30c43fd None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:10.088263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cbcb6d43-0109-4b90-a133-7a69b30c43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:10.126578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.132847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d2491-a2c5-4e5c-b1ae-081681fdcd66 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.167059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.188964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 86/159] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:10.219936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc254661-9647-4232-9631-b1b9b07c5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.220614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254661-9647-4232-9631-b1b9b07c5ca1 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.220894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254661-9647-4232-9631-b1b9b07c5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.221169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc254661-9647-4232-9631-b1b9b07c5ca1 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/7f6cadb0358b43e99e9de987571d5a50/roles/cebc95f212be431ea7e26e82669eefef` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.227936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254661-9647-4232-9631-b1b9b07c5ca1 None admin] RBAC: Authorizing `identity:create_grant(project_id=34c4b4b91bf74ea59cd59644b04803ed, user_id=7f6cadb0358b43e99e9de987571d5a50, role_id=cebc95f212be431ea7e26e82669eefef)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:10.229427 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc254661-9647-4232-9631-b1b9b07c5ca1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:10.311105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 74/160] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:09 2022] PUT /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/users/7f6cadb0358b43e99e9de987571d5a50/roles/cebc95f212be431ea7e26e82669eefef => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:10.520813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba194173-6116-45a3-8e04-ccaae4a36e5d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.521560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba194173-6116-45a3-8e04-ccaae4a36e5d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.522084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba194173-6116-45a3-8e04-ccaae4a36e5d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.523657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 87/161] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:10.529489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d487650-b31d-4ad0-90c4-505d434b4088 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.529773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d487650-b31d-4ad0-90c4-505d434b4088 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.530059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d487650-b31d-4ad0-90c4-505d434b4088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.554376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-2d487650-b31d-4ad0-90c4-505d434b4088 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:10.555622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2d487650-b31d-4ad0-90c4-505d434b4088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:10.591464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba194173-6116-45a3-8e04-ccaae4a36e5d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.672946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 75/162] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:10.676593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d487650-b31d-4ad0-90c4-505d434b4088 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.780729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba194173-6116-45a3-8e04-ccaae4a36e5d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.809634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:10.825762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d487650-b31d-4ad0-90c4-505d434b4088 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:10.838212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.839097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.839477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.839846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.856607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:10.867534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:10.868490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:10.869244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:10.870289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 88/163] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:10.874869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:10.875108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.875539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:10.875826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:10.876105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:10.895827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:10.905031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:10.905903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:10.906696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 76/164] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:10.914079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:10.926243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.016632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289e448-200e-445a-920f-e6115a3fe6d4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.083352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.085241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.085941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.087398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.088277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:11.088951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.091307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.103373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedc928-4f1b-4b67-a5bb-fbfb1c52e3f8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.109145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 89/165] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:11.110565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.174105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.176239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.177271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.177894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.180565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:11.181071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.182651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.196491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 77/166] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:11.197708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.218416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.312220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.342811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe39b-b0d1-4226-975b-faae7dd66f97 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.400824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094cb80-ed9c-4430-9edf-d0c16b9a7f11 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.435937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.436927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.437464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.437951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.458696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.459409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.459685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.459953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] PATH_INFO: `/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.461365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] RBAC: Authorizing `identity:get_user(user_id=6fcd63f0bb4e43ce8c0c41898fafca96)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.461492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:11.470926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.473167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 78/167] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/users/6fcd63f0bb4e43ce8c0c41898fafca96 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:11.473348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:11.474273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:11.475066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:11.475660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.475728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 90/168] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:11.480960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.653099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.692125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e739d67-558b-46e4-9ae7-072ddfbef3de None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.704755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a40ff-d3d9-4722-b869-a83363b39ada None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:11.746435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.747096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.747369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.747637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.749045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.750661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.758284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 79/169] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:11.763475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:11.787204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:11.787824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:11.788102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:11.788374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:11.831049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:11.908905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:11.910374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:11.947119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121d13c-f901-4fa1-b425-5d98e3dc8ac5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.003381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.004544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.004823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.005084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.005742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:12.006037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.007636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.024231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 80/170] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:12.025228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.039924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 91/171] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:12.040937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.046532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.094182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.145635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5781b3-9fba-4cb7-a24e-6699e5653419 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.204060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779946c-f617-4329-b46e-9555e4d6bcd4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.246008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.246644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.246949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.247282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] PATH_INFO: `/v3/users/ca2aa7b49753487fba927538fa939afc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.249096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] RBAC: Authorizing `identity:get_user(user_id=ca2aa7b49753487fba927538fa939afc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.250556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.252190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 92/172] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/users/ca2aa7b49753487fba927538fa939afc => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:12.252956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.270355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a171f8-e599-45c6-96ea-cda0e7cbc949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.271013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a171f8-e599-45c6-96ea-cda0e7cbc949 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.271291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a171f8-e599-45c6-96ea-cda0e7cbc949 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.271563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a171f8-e599-45c6-96ea-cda0e7cbc949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.376832 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a171f8-e599-45c6-96ea-cda0e7cbc949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.378758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a171f8-e599-45c6-96ea-cda0e7cbc949 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.423115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.470515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7acf8b-e52d-4921-8842-757696d07a23 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.488931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 81/173] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:12.494889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c6cf-4361-4ad9-a7e8-c3960ccd987e None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.495492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c6cf-4361-4ad9-a7e8-c3960ccd987e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.495964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.496997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c6cf-4361-4ad9-a7e8-c3960ccd987e None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.498630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 82/174] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:12.499582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3c6cf-4361-4ad9-a7e8-c3960ccd987e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.509013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.509654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.509930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.510198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.515147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.516622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.518292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 93/175] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:12.519103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.633482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3c6cf-4361-4ad9-a7e8-c3960ccd987e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.690524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94967420-9c00-41e4-952b-b46d7b4de984 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.699904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.728956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f89062-90c5-44c8-9acb-aeb11c86e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89062-90c5-44c8-9acb-aeb11c86e50f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.729765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89062-90c5-44c8-9acb-aeb11c86e50f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.730033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f89062-90c5-44c8-9acb-aeb11c86e50f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.732530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03575929-7b74-454d-b7e3-43d499dbe055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.733153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575929-7b74-454d-b7e3-43d499dbe055 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.733427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575929-7b74-454d-b7e3-43d499dbe055 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.733857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03575929-7b74-454d-b7e3-43d499dbe055 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.735866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575929-7b74-454d-b7e3-43d499dbe055 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.737392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03575929-7b74-454d-b7e3-43d499dbe055 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.739267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 94/176] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:12.740340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62536c6d-7443-4799-b3b1-7379367db862 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.740676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62536c6d-7443-4799-b3b1-7379367db862 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.740954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62536c6d-7443-4799-b3b1-7379367db862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.762121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-62536c6d-7443-4799-b3b1-7379367db862 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:12.763435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-62536c6d-7443-4799-b3b1-7379367db862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:12.817246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f89062-90c5-44c8-9acb-aeb11c86e50f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:12.819058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f89062-90c5-44c8-9acb-aeb11c86e50f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:12.819771 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.838597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 95/177] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:12.839452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62536c6d-7443-4799-b3b1-7379367db862 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.945026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62536c6d-7443-4799-b3b1-7379367db862 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:12.949086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 83/178] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:12.950566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76759f31-8c3c-41c3-9c07-59e7d9c7a984 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.951069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76759f31-8c3c-41c3-9c07-59e7d9c7a984 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.951556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76759f31-8c3c-41c3-9c07-59e7d9c7a984 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.953216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 84/179] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:12.954099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76759f31-8c3c-41c3-9c07-59e7d9c7a984 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:12.968420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:12.995689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8df582-5983-468d-a093-aa388b68e5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:12.996215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df582-5983-468d-a093-aa388b68e5bc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:12.996517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df582-5983-468d-a093-aa388b68e5bc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:12.996820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8df582-5983-468d-a093-aa388b68e5bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:12.997540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df582-5983-468d-a093-aa388b68e5bc None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=6fcd63f0bb4e43ce8c0c41898fafca96) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:12.997937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df582-5983-468d-a093-aa388b68e5bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.002691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8df582-5983-468d-a093-aa388b68e5bc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.005443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 96/180] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/role_assignments?user.id=6fcd63f0bb4e43ce8c0c41898fafca96&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:13.006634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240dcd6-14da-4c7c-938e-c8276d1cb5da None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.006934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240dcd6-14da-4c7c-938e-c8276d1cb5da None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.007201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240dcd6-14da-4c7c-938e-c8276d1cb5da None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.008400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 97/181] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:13.014234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240dcd6-14da-4c7c-938e-c8276d1cb5da None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.073281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76759f31-8c3c-41c3-9c07-59e7d9c7a984 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.079023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.110604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e473f2-c0ab-4cee-8cd3-2fdbcf43fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.111666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e473f2-c0ab-4cee-8cd3-2fdbcf43fd16 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.112177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e473f2-c0ab-4cee-8cd3-2fdbcf43fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.112654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e473f2-c0ab-4cee-8cd3-2fdbcf43fd16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.113663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e473f2-c0ab-4cee-8cd3-2fdbcf43fd16 None admin] RBAC: Adding query filter params (role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=ca2aa7b49753487fba927538fa939afc) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:13.114186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e473f2-c0ab-4cee-8cd3-2fdbcf43fd16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.116130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e473f2-c0ab-4cee-8cd3-2fdbcf43fd16 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.123872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 85/182] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:12 2022] GET /identity/v3/role_assignments?user.id=ca2aa7b49753487fba927538fa939afc&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:13.125507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d25ef-689a-4477-8379-929ee4a4c273 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.126105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d25ef-689a-4477-8379-929ee4a4c273 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.126653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d25ef-689a-4477-8379-929ee4a4c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.148108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-2e5d25ef-689a-4477-8379-929ee4a4c273 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:13.149691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2e5d25ef-689a-4477-8379-929ee4a4c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:13.155440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240dcd6-14da-4c7c-938e-c8276d1cb5da None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.237948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccb71e-59cf-44c0-b001-737fee92b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.239106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb71e-59cf-44c0-b001-737fee92b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.239801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb71e-59cf-44c0-b001-737fee92b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.241195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccb71e-59cf-44c0-b001-737fee92b9a1 None admin] PATH_INFO: `/v3/projects/182e2427c1dd4037969e519cfb144cac` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.244138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccb71e-59cf-44c0-b001-737fee92b9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=182e2427c1dd4037969e519cfb144cac)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.246061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccb71e-59cf-44c0-b001-737fee92b9a1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.250272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 98/183] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/projects/182e2427c1dd4037969e519cfb144cac => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:13.252900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fefcb-ae8a-4e68-80ab-bf2aab89a861 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.258468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fefcb-ae8a-4e68-80ab-bf2aab89a861 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.259147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fefcb-ae8a-4e68-80ab-bf2aab89a861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.288226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-745fefcb-ae8a-4e68-80ab-bf2aab89a861 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:13.290001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-745fefcb-ae8a-4e68-80ab-bf2aab89a861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:13.292763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 86/184] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:13.293713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d25ef-689a-4477-8379-929ee4a4c273 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.305628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.392082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 99/185] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:13.392892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fefcb-ae8a-4e68-80ab-bf2aab89a861 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.448264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d25ef-689a-4477-8379-929ee4a4c273 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.472911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.489311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.490330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.490924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.491396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.506772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:13.512928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:13.513837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:13.514642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:13.517404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 87/186] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:13.523915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.560348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fefcb-ae8a-4e68-80ab-bf2aab89a861 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.601013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.626904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a380df7-14e6-46d3-b881-827ff97cef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.627519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380df7-14e6-46d3-b881-827ff97cef7d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.627794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380df7-14e6-46d3-b881-827ff97cef7d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.628058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a380df7-14e6-46d3-b881-827ff97cef7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.629020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a380df7-14e6-46d3-b881-827ff97cef7d None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=182e2427c1dd4037969e519cfb144cac, user.id=ca2aa7b49753487fba927538fa939afc) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:13.629129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a380df7-14e6-46d3-b881-827ff97cef7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.630564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a380df7-14e6-46d3-b881-827ff97cef7d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.645443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 100/187] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/role_assignments?user.id=ca2aa7b49753487fba927538fa939afc&scope.project.id=182e2427c1dd4037969e519cfb144cac&role.id=41c7907fa20b41d3a299d45128434e86 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:13.646322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6646fc-e72f-49a9-a257-e2084e0cd8cf None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.650830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7aaa-4a36-4829-850c-c24ad443e3c3 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.651220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7aaa-4a36-4829-850c-c24ad443e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.651499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea7aaa-4a36-4829-850c-c24ad443e3c3 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.653194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 101/188] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:13.653962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7aaa-4a36-4829-850c-c24ad443e3c3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.701127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c24ed-c204-4820-9a40-944f8c20f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.702512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c24ed-c204-4820-9a40-944f8c20f812 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.704107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c24ed-c204-4820-9a40-944f8c20f812 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.704601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c24ed-c204-4820-9a40-944f8c20f812 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.705578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c24ed-c204-4820-9a40-944f8c20f812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:13.706089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c24ed-c204-4820-9a40-944f8c20f812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:13.708397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c24ed-c204-4820-9a40-944f8c20f812 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:13.722946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 88/189] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:13.727797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b1b7-1434-47d7-a67f-a398b3ae9a8f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.728430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b1b7-1434-47d7-a67f-a398b3ae9a8f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.728890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b1b7-1434-47d7-a67f-a398b3ae9a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.761423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-2058b1b7-1434-47d7-a67f-a398b3ae9a8f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:13.763081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2058b1b7-1434-47d7-a67f-a398b3ae9a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:13.790547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea7aaa-4a36-4829-850c-c24ad443e3c3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.803171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.829498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:13.830245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:13.830527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:13.830832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:13.845061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:13.850761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:13.851676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:13.852467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 102/190] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:13.853113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.860870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 89/191] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:13.862068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058b1b7-1434-47d7-a67f-a398b3ae9a8f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:13.923588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:13.972978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058b1b7-1434-47d7-a67f-a398b3ae9a8f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:13.995775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d143a9d-d5ee-46f7-aa44-64969d06bf98 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.017285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.017850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.018123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.018389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.020062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.021495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.023229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 90/192] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.027813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.035725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.036364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.036629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.037181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] PATH_INFO: `/v3/users/92878db743c04c66a6633c0727b0fda2` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.051920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] RBAC: Authorizing `identity:get_user(user_id=92878db743c04c66a6633c0727b0fda2)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.053405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.055189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 103/193] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:13 2022] GET /identity/v3/users/92878db743c04c66a6633c0727b0fda2 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.060134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.091018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.132941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cbc77-f4ec-47f9-a0bc-38928c8e742d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.156248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.165297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3fcd-2d0b-44b7-9c67-6454b285e50a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.166910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.167517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.167798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.168070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.168757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:14.169059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.170432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.179211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 91/194] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.180111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.204798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.205408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.205684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.205952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.206631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.208092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.275541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2c7c3-6d92-4b30-a654-b95c05236a77 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.308325 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.308946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.309194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.309455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.312806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 104/195] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:14 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:14.313916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.374240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.388925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.390490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.412930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.434011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b5725-2fc0-4bfc-ae12-611b74ee96eb None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.475944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.476943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.477237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.477508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.492854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:14.498829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:14.499705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:14.500523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 105/196] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:14.501187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.506711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 92/197] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:14.507669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.617070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.621488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806c210-533c-4ac3-a2c7-0ca8df7bf7c1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.634569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1b4d2-de75-4ba3-a622-dc2c5dac9011 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.664160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.664777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.665049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.665323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] PATH_INFO: `/v3/users/92878db743c04c66a6633c0727b0fda2` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.667072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=92878db743c04c66a6633c0727b0fda2)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.668530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.670113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 106/198] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/users/92878db743c04c66a6633c0727b0fda2 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.671320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.688538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.688868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.689486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.689757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.690017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.691712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:14.692064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.693518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.702786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 93/199] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.703829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.792433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89124739-8146-49be-bb97-16cfc0c2a5a7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.832973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.833602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.833889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.834230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.835459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.836911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:14.837758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3702e4-c7ec-4a95-a8bc-c6511274d69a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.838525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 107/200] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:14.839426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:14.880032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:14.880673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:14.881036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:14.881731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:14.906827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.934473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:14.959681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43406b3-5e59-41e2-b823-522fa316d0b0 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:14.960217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:14.961693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.002161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.002827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.003083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.004171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] PATH_INFO: `/v3/users/7f6cadb0358b43e99e9de987571d5a50` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.005345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] RBAC: Authorizing `identity:get_user(user_id=7f6cadb0358b43e99e9de987571d5a50)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.007521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.010161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 108/201] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/users/7f6cadb0358b43e99e9de987571d5a50 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.010907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.080640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 94/202] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:15.081627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.134033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.137290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76a80f-bdda-4a93-b2fd-41a9dfdb36b1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.177554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.178432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.178733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.179008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.179850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=92878db743c04c66a6633c0727b0fda2) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.180158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.181798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.186346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586daef-3e3a-4431-88ce-43eadfc754ed None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.188562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 109/203] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/role_assignments?user.id=92878db743c04c66a6633c0727b0fda2&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.189442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.208055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.226044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.227241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.227614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.228174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.312555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.314150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.319752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4aebf-37a1-4992-9252-68158c82a02d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.369485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.376148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.376801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.377179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.377685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.380042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.381536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.383713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 110/204] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.390161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.464251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 95/205] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:15.470762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.493237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:15.515924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c54d6-d4d1-4c45-a523-a27fa743ef1b None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.568744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.569358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.569637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.569969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.571015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] RBAC: Adding query filter params (role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=92878db743c04c66a6633c0727b0fda2) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.571338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.573443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.585687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 111/206] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/role_assignments?user.id=92878db743c04c66a6633c0727b0fda2&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.593167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd62bc-e0ac-4001-99c7-b44f304c7b01 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.653022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8825a-c191-494b-ae35-e92d4f117e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.653602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8825a-c191-494b-ae35-e92d4f117e22 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.653879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8825a-c191-494b-ae35-e92d4f117e22 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.654149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8825a-c191-494b-ae35-e92d4f117e22 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.655339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8825a-c191-494b-ae35-e92d4f117e22 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.656832 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8825a-c191-494b-ae35-e92d4f117e22 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.658787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 96/207] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:15.665142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:15.807936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac553cc7-7799-4f13-9a7f-3be8b6db4f4b None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:15.855111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75b7b3-0733-4ddb-8dac-722e08f29c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:15.856057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75b7b3-0733-4ddb-8dac-722e08f29c46 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:15.856554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75b7b3-0733-4ddb-8dac-722e08f29c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:15.857032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75b7b3-0733-4ddb-8dac-722e08f29c46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:15.857944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75b7b3-0733-4ddb-8dac-722e08f29c46 None admin] RBAC: Adding query filter params (role.id=cebc95f212be431ea7e26e82669eefef, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed, user.id=7f6cadb0358b43e99e9de987571d5a50) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:15.858441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75b7b3-0733-4ddb-8dac-722e08f29c46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:15.864673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75b7b3-0733-4ddb-8dac-722e08f29c46 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:15.871317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 112/208] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:15 2022] GET /identity/v3/role_assignments?user.id=7f6cadb0358b43e99e9de987571d5a50&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=cebc95f212be431ea7e26e82669eefef => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:16.826366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40f4a-6345-4cb1-ad8c-2e2565457079 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.826926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40f4a-6345-4cb1-ad8c-2e2565457079 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.826926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb40f4a-6345-4cb1-ad8c-2e2565457079 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.828506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 97/209] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:16.833905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e90ce-1e9f-474b-bce8-32f93a85dd24 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:16.834312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e90ce-1e9f-474b-bce8-32f93a85dd24 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:16.834475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e90ce-1e9f-474b-bce8-32f93a85dd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:16.853917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-042e90ce-1e9f-474b-bce8-32f93a85dd24 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:16.855126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-042e90ce-1e9f-474b-bce8-32f93a85dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:16.857063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:16.923385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 113/210] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:17.151909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3c60-d981-46f1-bf92-2418c67c9698 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.152526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3c60-d981-46f1-bf92-2418c67c9698 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.152740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3c60-d981-46f1-bf92-2418c67c9698 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.154025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 98/211] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:17.159626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d957-4616-4d9f-b7e0-c4d9503692d9 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.159843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d957-4616-4d9f-b7e0-c4d9503692d9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.160113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3d957-4616-4d9f-b7e0-c4d9503692d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.178608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4bb3d957-4616-4d9f-b7e0-c4d9503692d9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:17.179864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4bb3d957-4616-4d9f-b7e0-c4d9503692d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:17.196134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3c60-d981-46f1-bf92-2418c67c9698 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.214400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.259067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 114/212] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:17.307000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3c60-d981-46f1-bf92-2418c67c9698 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.342213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.342870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.343182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.343507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.354096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:17.359012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:17.359902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:17.360685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 99/213] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:17.366642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3d957-4616-4d9f-b7e0-c4d9503692d9 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.436288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.470528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3d957-4616-4d9f-b7e0-c4d9503692d9 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.505775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.506714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.507177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.507614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.508436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:17.508903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.510457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.522826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 115/214] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:17.525672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.533028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.627846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.644425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb275eed-94fc-4733-b6e3-6705635f06a6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.658818 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc08d-d7b6-4170-b640-8ecf4f58541f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.677556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.690228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c52b1-125d-43a5-9d82-f1916982fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.691058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c52b1-125d-43a5-9d82-f1916982fd89 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.691339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c52b1-125d-43a5-9d82-f1916982fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.691615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c52b1-125d-43a5-9d82-f1916982fd89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.692778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c52b1-125d-43a5-9d82-f1916982fd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.694167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c52b1-125d-43a5-9d82-f1916982fd89 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.695579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eec32-ae9e-4976-8a3a-149cfae05ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.696087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 116/215] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:17.697222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea25a55-59be-4f20-b093-878c49fc305f None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.697520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea25a55-59be-4f20-b093-878c49fc305f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.697777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea25a55-59be-4f20-b093-878c49fc305f None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.699158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 117/216] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:17.700753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eec32-ae9e-4976-8a3a-149cfae05ebe None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.701045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eec32-ae9e-4976-8a3a-149cfae05ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.701318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eec32-ae9e-4976-8a3a-149cfae05ebe None admin] PATH_INFO: `/v3/users/49733ec933e54c51be2ea01c04b53593` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.704850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea25a55-59be-4f20-b093-878c49fc305f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.715207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eec32-ae9e-4976-8a3a-149cfae05ebe None admin] RBAC: Authorizing `identity:get_user(user_id=49733ec933e54c51be2ea01c04b53593)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.716686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eec32-ae9e-4976-8a3a-149cfae05ebe None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.718723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 100/217] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/users/49733ec933e54c51be2ea01c04b53593 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:17.719498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f891-dc69-40ec-9120-1ee2d70ac258 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.719776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f891-dc69-40ec-9120-1ee2d70ac258 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.720045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564f891-dc69-40ec-9120-1ee2d70ac258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.739101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e564f891-dc69-40ec-9120-1ee2d70ac258 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:17.740282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e564f891-dc69-40ec-9120-1ee2d70ac258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:17.813814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 101/218] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:17.814974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f891-dc69-40ec-9120-1ee2d70ac258 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:17.825470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea25a55-59be-4f20-b093-878c49fc305f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.868536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bccbc-dbf2-449f-9ee2-79bb19b8e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.869202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bccbc-dbf2-449f-9ee2-79bb19b8e525 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.869495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bccbc-dbf2-449f-9ee2-79bb19b8e525 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.869860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bccbc-dbf2-449f-9ee2-79bb19b8e525 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.870581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bccbc-dbf2-449f-9ee2-79bb19b8e525 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:17.872140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bccbc-dbf2-449f-9ee2-79bb19b8e525 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:17.901159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:17.939728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564f891-dc69-40ec-9120-1ee2d70ac258 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:17.973354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:17.973890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.974164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.974433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.990907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 118/219] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:17 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:17.990907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1136c-3a6e-4a9b-adc2-4f5526bfe688 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.990907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1136c-3a6e-4a9b-adc2-4f5526bfe688 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.990907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1136c-3a6e-4a9b-adc2-4f5526bfe688 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:17.990907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 119/220] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:17.993606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4da72-9507-43fd-8c15-d0000958967b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:17.993606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4da72-9507-43fd-8c15-d0000958967b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:17.993997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4da72-9507-43fd-8c15-d0000958967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.017604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-22c4da72-9507-43fd-8c15-d0000958967b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:18.025937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-22c4da72-9507-43fd-8c15-d0000958967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:18.060029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.061894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.084503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.105609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 120/221] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:18.107018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4da72-9507-43fd-8c15-d0000958967b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.145741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.200820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 102/222] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:18.206907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.231905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4da72-9507-43fd-8c15-d0000958967b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.272168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.273115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.273539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.273953 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.287687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:18.293413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:18.294370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:18.295183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 121/223] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:18.302468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.327883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebef786-beab-4583-a301-d00b05fbb21d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.352933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.379865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.381252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.381738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.382375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.384667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.386363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.389362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 103/224] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.395077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.428768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31b62-5402-4ab5-b0f6-9400892f3780 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.440045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.470596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.471415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.471766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.472621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.473358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.473728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.475237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.486870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 122/225] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:18.488174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.526012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfff65-abf6-410d-9ae1-deb4598b5ec4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.562375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.563025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.563294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.563561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.564303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=49733ec933e54c51be2ea01c04b53593) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:18.564593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.566354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.572370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 104/226] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/role_assignments?user.id=49733ec933e54c51be2ea01c04b53593&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=41c7907fa20b41d3a299d45128434e86 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:18.578703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.653777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc425d8-e3af-47c5-aaa1-3b5b9e04a7ae None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.665789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.741601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:18.748165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c72a-f0df-4ad2-9586-b44ebb3a4204 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.751734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.759122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.759122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.759122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.784123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:18.790638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:18.791614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:18.792395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 123/227] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:18.797567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.809150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:18.809915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:18.810208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:18.810483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] PATH_INFO: `/v3/users/92878db743c04c66a6633c0727b0fda2` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:18.813335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=92878db743c04c66a6633c0727b0fda2)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:18.815413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:18.817973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 105/228] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/users/92878db743c04c66a6633c0727b0fda2 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:18.823585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:18.962004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc81f1-26c9-4746-8afd-37ded15de4d6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:18.984833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e71a6e-2052-4441-b1a7-1ca8c18c21c7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.006188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.007324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.007817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.008554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.009899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.012217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.014216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 106/229] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:19.020376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.058389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.059566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.063150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.063648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.064537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:19.065040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.067211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.080542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.091583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 124/230] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:19.096946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.164401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84c85c-37c2-4d75-b378-6df7da5501a3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.167093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.201805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.202849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.203350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.203816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/92878db743c04c66a6633c0727b0fda2/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.205996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f802c6aa541e18d16cf2e89d37d7d, user_id=92878db743c04c66a6633c0727b0fda2, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.208281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.253950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fc0a3-083e-4f47-9b34-05460714676e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.284995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 107/231] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:19 2022] PUT /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/92878db743c04c66a6633c0727b0fda2/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:19.292435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.293097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.293378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.293653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] PATH_INFO: `/v3/users/92878db743c04c66a6633c0727b0fda2` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.294933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] RBAC: Authorizing `identity:get_user(user_id=92878db743c04c66a6633c0727b0fda2)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.296533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.298756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 125/232] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:19 2022] GET /identity/v3/users/92878db743c04c66a6633c0727b0fda2 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:19.304827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.471266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.483533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5daaf-6026-4012-8ba3-3e5a14aac924 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.525496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01d25c-8cac-460b-8552-227aeff75ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.532779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d25c-8cac-460b-8552-227aeff75ea9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.532779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d25c-8cac-460b-8552-227aeff75ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.532779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01d25c-8cac-460b-8552-227aeff75ea9 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.532779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01d25c-8cac-460b-8552-227aeff75ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.532779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01d25c-8cac-460b-8552-227aeff75ea9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.532779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 108/233] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:19 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:19.537676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:19.644906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:19.650508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3fe34-da24-4109-80c8-fad323e26f17 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:19.685869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6229b5-3b5a-429e-bd47-e643089a06ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:19.686594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6229b5-3b5a-429e-bd47-e643089a06ca None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:19.686909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6229b5-3b5a-429e-bd47-e643089a06ca None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:19.687187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6229b5-3b5a-429e-bd47-e643089a06ca None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/92878db743c04c66a6633c0727b0fda2/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:19.689578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6229b5-3b5a-429e-bd47-e643089a06ca None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f802c6aa541e18d16cf2e89d37d7d, user_id=92878db743c04c66a6633c0727b0fda2, role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:19.691695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6229b5-3b5a-429e-bd47-e643089a06ca None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:19.785451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 126/234] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:19 2022] PUT /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/92878db743c04c66a6633c0727b0fda2/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:20.540054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b35aa-f52e-4460-b198-a3951a0e06ad None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.540569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b35aa-f52e-4460-b198-a3951a0e06ad None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.540569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b35aa-f52e-4460-b198-a3951a0e06ad None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.542199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 109/235] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:20.547359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b8db-bf70-4af2-8b3c-fe08d4532cf7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.547754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b8db-bf70-4af2-8b3c-fe08d4532cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.547918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4b8db-bf70-4af2-8b3c-fe08d4532cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.566789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4bc4b8db-bf70-4af2-8b3c-fe08d4532cf7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:20.567978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4bc4b8db-bf70-4af2-8b3c-fe08d4532cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:20.645109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 127/236] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:20.738930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd41b0-35ec-45ec-a1b8-674443ad240a None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.739227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd41b0-35ec-45ec-a1b8-674443ad240a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.739477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd41b0-35ec-45ec-a1b8-674443ad240a None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.741103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 110/237] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:20.746147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbcbf1-11c8-4582-96f6-cf013f051303 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:20.746495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbcbf1-11c8-4582-96f6-cf013f051303 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:20.746800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbcbf1-11c8-4582-96f6-cf013f051303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:20.771627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1ecbcbf1-11c8-4582-96f6-cf013f051303 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:20.772811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1ecbcbf1-11c8-4582-96f6-cf013f051303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:20.856000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 128/238] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:21.016267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd41b0-35ec-45ec-a1b8-674443ad240a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.145030 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd41b0-35ec-45ec-a1b8-674443ad240a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.184131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.185188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.185701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.186171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.200091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:21.205596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:21.206591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:21.207392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:21.210244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 111/239] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:21.219020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbcbf1-11c8-4582-96f6-cf013f051303 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.245244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.262392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.286274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.378353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbcbf1-11c8-4582-96f6-cf013f051303 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.379457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785fd45-0c6e-4a4b-a84c-fc7a4ec0d763 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.416460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2292e2c-81be-4526-ac79-61ad3f8339c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.417282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2292e2c-81be-4526-ac79-61ad3f8339c9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.417793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2292e2c-81be-4526-ac79-61ad3f8339c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.418312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2292e2c-81be-4526-ac79-61ad3f8339c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.419696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2292e2c-81be-4526-ac79-61ad3f8339c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.420517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b683447-cab7-454b-8863-0e517d04ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.421128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b683447-cab7-454b-8863-0e517d04ee74 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.421405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b683447-cab7-454b-8863-0e517d04ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.421672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b683447-cab7-454b-8863-0e517d04ee74 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.422006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2292e2c-81be-4526-ac79-61ad3f8339c9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.422332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b683447-cab7-454b-8863-0e517d04ee74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:21.422630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b683447-cab7-454b-8863-0e517d04ee74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.424053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 112/240] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:21.425869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f630f-c93f-4d8c-a4d5-15ac729b3ac9 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.426310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f630f-c93f-4d8c-a4d5-15ac729b3ac9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.426753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f630f-c93f-4d8c-a4d5-15ac729b3ac9 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.432167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b683447-cab7-454b-8863-0e517d04ee74 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.432400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 113/241] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:21.433991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f630f-c93f-4d8c-a4d5-15ac729b3ac9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.439762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 129/242] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:21.441135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4047-4567-4bac-9155-2c055ebe03ca None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.441419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4047-4567-4bac-9155-2c055ebe03ca None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.441691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4047-4567-4bac-9155-2c055ebe03ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.465604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9adb4047-4567-4bac-9155-2c055ebe03ca None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:21.467098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9adb4047-4567-4bac-9155-2c055ebe03ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:21.531551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.545900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f630f-c93f-4d8c-a4d5-15ac729b3ac9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.566699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 130/243] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:21.566699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb4047-4567-4bac-9155-2c055ebe03ca None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.579533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.624760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.625588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.625937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.626295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.627103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.628698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.678810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb4047-4567-4bac-9155-2c055ebe03ca None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.714981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.715901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.719352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.719352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] PATH_INFO: `/v3/users/b4f33d42471a426f9d58dbc8b88064fb` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.732195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f33d42471a426f9d58dbc8b88064fb)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:21.733830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:21.736011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 131/244] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:21 2022] GET /identity/v3/users/b4f33d42471a426f9d58dbc8b88064fb => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:21.743765 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:21.753062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 114/245] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:21 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:21.814906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:21.851825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e457952-da07-40c8-bbc6-ef31754cc073 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:21.902090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:21.902742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:21.903022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:21.903293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:21.911757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.024698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.026378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.083091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3b17c-eaf3-45eb-9bd6-bca412964753 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.104511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:22.123841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.124526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.124813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.125083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.137337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:22.142752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:22.144209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:22.144993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 115/246] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:22.149977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 132/247] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:22.154785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.155994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.158642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:22.273135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e0155-3180-4ffe-b257-310588a42c9a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.286041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0670c4b-5912-4aaf-b5ab-c80b77781469 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.315070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f47f59-90ef-4380-bbd5-a13a718137a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.316222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f47f59-90ef-4380-bbd5-a13a718137a1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.316494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f47f59-90ef-4380-bbd5-a13a718137a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.316760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f47f59-90ef-4380-bbd5-a13a718137a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.317706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f47f59-90ef-4380-bbd5-a13a718137a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:22.318004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f47f59-90ef-4380-bbd5-a13a718137a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.319611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f47f59-90ef-4380-bbd5-a13a718137a1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.330221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 116/248] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:22.332142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163597-f3e1-490b-b17a-ab37370c51be None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.332271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24d5af-4a18-42d8-a811-c128b39158a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.332366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163597-f3e1-490b-b17a-ab37370c51be None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.332609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163597-f3e1-490b-b17a-ab37370c51be None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.332817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d5af-4a18-42d8-a811-c128b39158a0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.333138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d5af-4a18-42d8-a811-c128b39158a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.333407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24d5af-4a18-42d8-a811-c128b39158a0 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.333810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 117/249] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:22.335909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24d5af-4a18-42d8-a811-c128b39158a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.337514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24d5af-4a18-42d8-a811-c128b39158a0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.338357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163597-f3e1-490b-b17a-ab37370c51be None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.339432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 133/250] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:22.344384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422806-b849-4748-a27f-bd9a83825dd2 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.344669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422806-b849-4748-a27f-bd9a83825dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.344946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06422806-b849-4748-a27f-bd9a83825dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.364750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-06422806-b849-4748-a27f-bd9a83825dd2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:22.365934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-06422806-b849-4748-a27f-bd9a83825dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:22.400970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:22.433850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:22.450479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 134/251] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:22.454956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06422806-b849-4748-a27f-bd9a83825dd2 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.500674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163597-f3e1-490b-b17a-ab37370c51be None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.594911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06422806-b849-4748-a27f-bd9a83825dd2 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.596065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.597370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.597862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.598334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] PATH_INFO: `/v3/users/49733ec933e54c51be2ea01c04b53593` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.599741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] RBAC: Authorizing `identity:get_user(user_id=49733ec933e54c51be2ea01c04b53593)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.601374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.603478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 118/252] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/users/49733ec933e54c51be2ea01c04b53593 => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:22.608554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.654961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b7220-8b56-47f6-b926-539366c67633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.655747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b7220-8b56-47f6-b926-539366c67633 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.656032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b7220-8b56-47f6-b926-539366c67633 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.656308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b7220-8b56-47f6-b926-539366c67633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.657043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b7220-8b56-47f6-b926-539366c67633 None admin] RBAC: Adding query filter params (role.id=cebc95f212be431ea7e26e82669eefef, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=b4f33d42471a426f9d58dbc8b88064fb) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:22.657410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b7220-8b56-47f6-b926-539366c67633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.658932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b7220-8b56-47f6-b926-539366c67633 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.670894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 135/253] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/role_assignments?user.id=b4f33d42471a426f9d58dbc8b88064fb&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=cebc95f212be431ea7e26e82669eefef => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:22.672524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d181ea-41ec-49b7-8e33-9fbdb3c53b42 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.672810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d181ea-41ec-49b7-8e33-9fbdb3c53b42 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.673086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d181ea-41ec-49b7-8e33-9fbdb3c53b42 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.674486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 136/254] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:22.696559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8b298-5950-4af7-840d-fe6448b565e4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.696841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8b298-5950-4af7-840d-fe6448b565e4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.697106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8b298-5950-4af7-840d-fe6448b565e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.746232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-edc8b298-5950-4af7-840d-fe6448b565e4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:22.754794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-edc8b298-5950-4af7-840d-fe6448b565e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:22.806014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:22.879363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed41eb-6da7-4679-8366-66008b90726a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:22.903744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 137/255] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:22.904722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8b298-5950-4af7-840d-fe6448b565e4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.953304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:22.953951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:22.954226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:22.954493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:22.956466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:22.957985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:22.959726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 119/256] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:22.972222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:22.980967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.044595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8b298-5950-4af7-840d-fe6448b565e4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.086529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.087257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.087591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.087864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.106109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:23.111144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:23.111984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:23.112858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:23.118766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 138/257] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:23.119680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.177354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f7358-d6ff-46bc-8029-385658fa50e4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.192900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.240365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.241045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.241320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.241589 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/49733ec933e54c51be2ea01c04b53593/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.248006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f802c6aa541e18d16cf2e89d37d7d, user_id=49733ec933e54c51be2ea01c04b53593, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.249486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.332812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 120/258] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:22 2022] PUT /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/49733ec933e54c51be2ea01c04b53593/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:23.351791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d70cc-4d61-40bd-baaf-e13b0f63ebc6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.396552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.405828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.406445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.406742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.407014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.407742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:23.408044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.409496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.425966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 139/259] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:23.431696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.471079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.552969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a860f-b48a-4a7f-8c18-b065c91fd64c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.583565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.609761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0363e-e3c8-4646-9f0f-4e89c9a27170 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.610413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.610987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.611477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.612069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.632631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:23.638257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:23.639157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:23.639933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:23.642139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 121/260] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:23.651197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.651197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.651197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.651197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] PATH_INFO: `/v3/users/92878db743c04c66a6633c0727b0fda2` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.651479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] RBAC: Authorizing `identity:get_user(user_id=92878db743c04c66a6633c0727b0fda2)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.651479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.652733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 140/261] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/users/92878db743c04c66a6633c0727b0fda2 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:23.653186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.657794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:23.819755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57ae51-e1f8-4793-af7f-c1909d4a9d89 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.858073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d33ed-8318-4ce9-b8a2-4861525e1d54 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:23.898186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.898372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.899248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.899248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.899525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.924121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:23.924781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:23.925061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:23.929429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:23.929429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:23.929429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:23.929429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:23.935001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:23.951812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 122/262] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:23.959855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.028287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.030013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.133930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 141/263] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:24.134465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0270fdf-2960-4c7e-9f65-75572f1ce463 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.141724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.199627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.200397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.200822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.201306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] PATH_INFO: `/v3/users/92878db743c04c66a6633c0727b0fda2` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.207332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=92878db743c04c66a6633c0727b0fda2)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.209097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.211381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 123/264] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:23 2022] GET /identity/v3/users/92878db743c04c66a6633c0727b0fda2 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:24.216577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.223329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.310285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.326386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e14eb-be84-44b4-9e58-af5d0c8a9e99 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.384392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092bddf-b4e3-4c1e-b922-d1f5e0687ae8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.419275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.419927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.420199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.420468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.421631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.423187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.425314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 142/265] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:24.430757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.448727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.449350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.449624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.449892 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.578136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.579756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.684661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eccb2e-a19c-4a62-8ae5-6959b8ee49e7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.700092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.724431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:24.775740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.776339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.776872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.777144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:24.777871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=92878db743c04c66a6633c0727b0fda2) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:24.778182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:24.779644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:24.795409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 143/266] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/role_assignments?user.id=92878db743c04c66a6633c0727b0fda2&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:24.815870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 124/267] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:35:24.821709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:24.951805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad36d4-de3d-4c1f-b45c-dd6f93a48c52 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:24.996258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d24ce-1080-456d-9878-4d636c5307b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:24.996908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d24ce-1080-456d-9878-4d636c5307b3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:24.997189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d24ce-1080-456d-9878-4d636c5307b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:24.997469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d24ce-1080-456d-9878-4d636c5307b3 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.004145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d24ce-1080-456d-9878-4d636c5307b3 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.005643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d24ce-1080-456d-9878-4d636c5307b3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.007513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 144/268] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:24 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:25.013736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.052609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01a5b-f6c2-41cd-95b0-996a0a07c0e5 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.052942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01a5b-f6c2-41cd-95b0-996a0a07c0e5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.053178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d01a5b-f6c2-41cd-95b0-996a0a07c0e5 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.054705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 145/269] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:25.059741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c01d1-df79-4895-a7b6-c2ee19915b7d None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.060025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c01d1-df79-4895-a7b6-c2ee19915b7d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.060302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c01d1-df79-4895-a7b6-c2ee19915b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.092534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b08c01d1-df79-4895-a7b6-c2ee19915b7d None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:25.094075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b08c01d1-df79-4895-a7b6-c2ee19915b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:25.172725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.198418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f51b3-720a-4c68-a61d-cbbc49638ca4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.226864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 146/270] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 28 09:35:25.255212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b081b-7df5-47ea-a5b8-4d5b8f7b1172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.256161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b081b-7df5-47ea-a5b8-4d5b8f7b1172 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.256661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b081b-7df5-47ea-a5b8-4d5b8f7b1172 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.257142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b081b-7df5-47ea-a5b8-4d5b8f7b1172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.258108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b081b-7df5-47ea-a5b8-4d5b8f7b1172 None admin] RBAC: Adding query filter params (role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=92878db743c04c66a6633c0727b0fda2) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:25.258621 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b081b-7df5-47ea-a5b8-4d5b8f7b1172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:25.260282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b081b-7df5-47ea-a5b8-4d5b8f7b1172 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:25.266939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 125/271] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/role_assignments?user.id=92878db743c04c66a6633c0727b0fda2&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:25.433114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a217b0-0bc4-4693-b848-62e117604d3c None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.433791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a217b0-0bc4-4693-b848-62e117604d3c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.434301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a217b0-0bc4-4693-b848-62e117604d3c None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.435933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 147/272] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:25.441737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6fc4-7c72-4b17-a67e-bf5a945877fb None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.442330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6fc4-7c72-4b17-a67e-bf5a945877fb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.442826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6fc4-7c72-4b17-a67e-bf5a945877fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.465814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-15fb6fc4-7c72-4b17-a67e-bf5a945877fb None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:25.467425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-15fb6fc4-7c72-4b17-a67e-bf5a945877fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:25.488078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.557081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 126/273] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:25.726941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a217b0-0bc4-4693-b848-62e117604d3c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.732451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f22c8-ea92-474b-8dbf-34618282b4e8 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.732908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f22c8-ea92-474b-8dbf-34618282b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.732985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f22c8-ea92-474b-8dbf-34618282b4e8 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.734333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 127/274] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:25.739513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227be56-1137-4994-a9bb-1c07469adfe7 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.739742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227be56-1137-4994-a9bb-1c07469adfe7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.739996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227be56-1137-4994-a9bb-1c07469adfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.758619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6227be56-1137-4994-a9bb-1c07469adfe7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:25.759808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6227be56-1137-4994-a9bb-1c07469adfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:25.844562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 128/275] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:25.865682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a217b0-0bc4-4693-b848-62e117604d3c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:25.903458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227be56-1137-4994-a9bb-1c07469adfe7 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.904442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:25.905085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:25.905357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:25.905622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:25.919555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:25.924435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:25.925417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:25.926387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 148/276] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:25.931190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:25.972094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:25.995325 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.020992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227be56-1137-4994-a9bb-1c07469adfe7 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.031856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483542c-7af8-43cc-928a-3888b678d351 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.056672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.057640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.058156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.058566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.059907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.061728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.063847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 129/277] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:26.068752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.069536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.069812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.070079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.070850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:26.071154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.071954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.072727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.088438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 149/278] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:26.089791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.186703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dccf6f-a220-4784-943b-7d424e7fbc4d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.197798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.201181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b6cda-07a9-44cb-92b1-bb6965906ae2 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.223919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.224816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.225263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.225703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.226565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.228203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.236702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.238306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.238586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.239234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] PATH_INFO: `/v3/users/725bd3bbed5b474dbc98e73dcf745d71` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.252959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] RBAC: Authorizing `identity:get_user(user_id=725bd3bbed5b474dbc98e73dcf745d71)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.254857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.256484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 150/279] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/users/725bd3bbed5b474dbc98e73dcf745d71 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:26.257249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.319984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.324440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 130/280] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:26 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:26.325235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.361010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc4da5-7c01-4f9d-b65b-2ec0680cbd40 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.402937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c4836-12c4-4f52-9ca0-069f1faf9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.403588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c4836-12c4-4f52-9ca0-069f1faf9f56 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.403864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c4836-12c4-4f52-9ca0-069f1faf9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.404137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c4836-12c4-4f52-9ca0-069f1faf9f56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.415801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c4836-12c4-4f52-9ca0-069f1faf9f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e77c4836-12c4-4f52-9ca0-069f1faf9f56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:26.420854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:26.421784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:26.422582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 151/281] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:26.423846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624d3e-1b48-4053-ac13-8773d2841e0d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.423846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624d3e-1b48-4053-ac13-8773d2841e0d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.423846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12624d3e-1b48-4053-ac13-8773d2841e0d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.425754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 152/282] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:26.430754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624d3e-1b48-4053-ac13-8773d2841e0d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.447204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602d9ab-8a9e-4b68-9383-2bece1b14772 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.451927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.486117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328aea7-6a4f-4edf-8360-3f945bfc2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.486758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328aea7-6a4f-4edf-8360-3f945bfc2d03 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.487552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328aea7-6a4f-4edf-8360-3f945bfc2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.487820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328aea7-6a4f-4edf-8360-3f945bfc2d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.488551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328aea7-6a4f-4edf-8360-3f945bfc2d03 None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, user.id=725bd3bbed5b474dbc98e73dcf745d71, scope.system=all) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:26.488873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328aea7-6a4f-4edf-8360-3f945bfc2d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.490315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328aea7-6a4f-4edf-8360-3f945bfc2d03 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.502692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 131/283] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/role_assignments?user.id=725bd3bbed5b474dbc98e73dcf745d71&scope.system=all&role.id=41c7907fa20b41d3a299d45128434e86 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:26.502692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb05-5e8c-4d78-ba69-eabc6ea42b97 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.502692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb05-5e8c-4d78-ba69-eabc6ea42b97 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.502692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fbb05-5e8c-4d78-ba69-eabc6ea42b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.520575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-740fbb05-5e8c-4d78-ba69-eabc6ea42b97 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:26.522490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-740fbb05-5e8c-4d78-ba69-eabc6ea42b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:26.569389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12624d3e-1b48-4053-ac13-8773d2841e0d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.610623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.623389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 132/284] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:26.624220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.625098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.625551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.626017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.626901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:26.627398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.628989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.639690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 153/285] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:26.645490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fbb05-5e8c-4d78-ba69-eabc6ea42b97 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.771520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fbb05-5e8c-4d78-ba69-eabc6ea42b97 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:26.813177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:26.813866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:26.814146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:26.814413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] PATH_INFO: `/v3/users/b4f33d42471a426f9d58dbc8b88064fb` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:26.816620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f33d42471a426f9d58dbc8b88064fb)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:26.818058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:26.819651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 133/286] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/users/b4f33d42471a426f9d58dbc8b88064fb => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:26.827788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.944409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:26.953510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:26.985190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ff2da-4d6c-4d5d-89ff-d9d16d1c29e7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.027611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.028675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.029168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.029669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.031066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.032829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.035676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 154/287] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:27.044281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.057834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.126288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd180d9-374a-425b-bf4d-e9600f3e7165 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.182934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2d613-8381-4631-8c0f-5a735e081227 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.192534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.193171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.193446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.193712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.218388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:27.218876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.219529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.219848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.220188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/b4f33d42471a426f9d58dbc8b88064fb/roles/cebc95f212be431ea7e26e82669eefef` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.222739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f802c6aa541e18d16cf2e89d37d7d, user_id=b4f33d42471a426f9d58dbc8b88064fb, role_id=cebc95f212be431ea7e26e82669eefef)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.224171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:27.224564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:27.225405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:27.226260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:27.231084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 134/288] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:27.232060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.301282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 155/289] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:35:27 2022] PUT /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/users/b4f33d42471a426f9d58dbc8b88064fb/roles/cebc95f212be431ea7e26e82669eefef => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:27.357459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0207c83-2acb-49e4-9c23-54da3ebdbb37 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.382819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.400263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.401026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.401305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.401822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.402505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:27.402833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.404261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.419015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 135/290] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:27.425049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.437175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.538204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee8257-4a1b-42ef-b83a-abe291377705 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.574542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.575233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.575921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.576199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] PATH_INFO: `/v3/users/49733ec933e54c51be2ea01c04b53593` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.577379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] RBAC: Authorizing `identity:get_user(user_id=49733ec933e54c51be2ea01c04b53593)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.578861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:27.581388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 156/291] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/users/49733ec933e54c51be2ea01c04b53593 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:27.588172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:27.741957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698fd27-f776-4903-9fb8-604e9c147ac7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:27.798185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:27.798839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:27.799101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:27.799891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:27.875132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:27.902249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:27.903775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.035787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 136/292] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:28.041485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.142696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.175088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6b3f1-323d-48dd-85d9-a5c5cada4e31 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.213497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac22c1-a69f-44f2-99eb-255857e113de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.214128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac22c1-a69f-44f2-99eb-255857e113de None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.214405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac22c1-a69f-44f2-99eb-255857e113de None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.214699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac22c1-a69f-44f2-99eb-255857e113de None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.215817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac22c1-a69f-44f2-99eb-255857e113de None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.217239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac22c1-a69f-44f2-99eb-255857e113de None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.219254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 157/293] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:28.227772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:28.333368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:28.352254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d5e6-d788-4e84-bc4c-d239e268dfd2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:28.395095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36944ee-e125-4906-82b5-f0f620962180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:28.395601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36944ee-e125-4906-82b5-f0f620962180 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.395876 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36944ee-e125-4906-82b5-f0f620962180 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.396146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36944ee-e125-4906-82b5-f0f620962180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.396866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36944ee-e125-4906-82b5-f0f620962180 None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=49733ec933e54c51be2ea01c04b53593) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:28.397172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36944ee-e125-4906-82b5-f0f620962180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:28.398613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36944ee-e125-4906-82b5-f0f620962180 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:28.405296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 137/294] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:28 2022] GET /identity/v3/role_assignments?user.id=49733ec933e54c51be2ea01c04b53593&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=41c7907fa20b41d3a299d45128434e86 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:28.835929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0eec8-53c9-4a10-8787-ed7fe79de830 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.836318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0eec8-53c9-4a10-8787-ed7fe79de830 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.836496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0eec8-53c9-4a10-8787-ed7fe79de830 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.837969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 158/295] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:28.843080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac140e77-bef1-44ee-a856-56dc542ee5ec None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:28.843539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac140e77-bef1-44ee-a856-56dc542ee5ec None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:28.843615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac140e77-bef1-44ee-a856-56dc542ee5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:28.864866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ac140e77-bef1-44ee-a856-56dc542ee5ec None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:28.866032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ac140e77-bef1-44ee-a856-56dc542ee5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:28.951294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 138/296] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:29.248327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0eec8-53c9-4a10-8787-ed7fe79de830 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.286196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07ae38-85ff-4264-9fc7-a5556f5543a5 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.286505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07ae38-85ff-4264-9fc7-a5556f5543a5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.286766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07ae38-85ff-4264-9fc7-a5556f5543a5 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.288596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 139/297] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:29.295647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a073a-3837-4170-b499-d89422c9a3d8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.295918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a073a-3837-4170-b499-d89422c9a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.296180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a073a-3837-4170-b499-d89422c9a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.316449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-624a073a-3837-4170-b499-d89422c9a3d8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:29.317919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-624a073a-3837-4170-b499-d89422c9a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:29.363732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0eec8-53c9-4a10-8787-ed7fe79de830 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.389235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 140/298] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:29.390331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059682-a1dd-4144-a004-47e780f17ce2 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.390619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059682-a1dd-4144-a004-47e780f17ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.390918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059682-a1dd-4144-a004-47e780f17ce2 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.392130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 141/299] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:29.398177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917666a2-8fc2-4a1c-8ae4-abc73eb33318 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.398601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917666a2-8fc2-4a1c-8ae4-abc73eb33318 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.399029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917666a2-8fc2-4a1c-8ae4-abc73eb33318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.407365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.408278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.409303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.409773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.420870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:29.421565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-917666a2-8fc2-4a1c-8ae4-abc73eb33318 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:29.422976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-917666a2-8fc2-4a1c-8ae4-abc73eb33318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:29.426852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:29.427900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:29.428808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:29.434960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 159/300] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:29.435152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.437743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.440549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.500162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 142/301] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:29.547974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafb6f1-e4ee-4d6c-a61a-569b01e066dc None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.583426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.584380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.584874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.585332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.586206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:29.586719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:29.588280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:29.597064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 160/302] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:29.602825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917666a2-8fc2-4a1c-8ae4-abc73eb33318 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.655079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.709352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917666a2-8fc2-4a1c-8ae4-abc73eb33318 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.739428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.746614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.747501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.747912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.748333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] PATH_INFO: `/v3/users/725bd3bbed5b474dbc98e73dcf745d71` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.749598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] RBAC: Authorizing `identity:get_user(user_id=725bd3bbed5b474dbc98e73dcf745d71)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:29.761327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:29.761327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 143/303] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/users/725bd3bbed5b474dbc98e73dcf745d71 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:29.761327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.769988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.781316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddbdd-330f-47b5-be9a-7a3b7a53ca2a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.824135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.824828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.825104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.825418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.839501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:29.845086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:29.846009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:29.847058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:29.848173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 161/304] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:29.848173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:29.890770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e7b7a-83c0-4c8b-9464-f88e052516c1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.926410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96769d8e-5c90-4ae1-b70b-4a2bdc3b2304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.927082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769d8e-5c90-4ae1-b70b-4a2bdc3b2304 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.927356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769d8e-5c90-4ae1-b70b-4a2bdc3b2304 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.927625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96769d8e-5c90-4ae1-b70b-4a2bdc3b2304 None admin] PATH_INFO: `/v3/system/users/725bd3bbed5b474dbc98e73dcf745d71/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.928993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96769d8e-5c90-4ae1-b70b-4a2bdc3b2304 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=725bd3bbed5b474dbc98e73dcf745d71, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:29.930357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96769d8e-5c90-4ae1-b70b-4a2bdc3b2304 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:29.954382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a575845-d161-42c4-a0e8-14942290e538 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:29.978790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:29.987624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:29.988237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:29.988508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:29.988771 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:29.989867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:29.991348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:29.992858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 162/305] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:29.993614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.004738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 144/306] 10.222.0.49 () {58 vars in 1334 bytes} [Fri Oct 28 09:35:29 2022] PUT /identity/v3/system/users/725bd3bbed5b474dbc98e73dcf745d71/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:30.005990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fad1f-82b5-4e02-98ef-9ed1d7d1e90f None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.006271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fad1f-82b5-4e02-98ef-9ed1d7d1e90f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.006547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fad1f-82b5-4e02-98ef-9ed1d7d1e90f None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.008017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 145/307] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:30.013908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fad1f-82b5-4e02-98ef-9ed1d7d1e90f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.101228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:30.105477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ccedb-b852-4b68-aa61-9fbba8a7478f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.136692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fad1f-82b5-4e02-98ef-9ed1d7d1e90f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.145063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4fdda-cb84-414e-ba22-a2b1afb1f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.145943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4fdda-cb84-414e-ba22-a2b1afb1f066 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.146375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4fdda-cb84-414e-ba22-a2b1afb1f066 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.147019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4fdda-cb84-414e-ba22-a2b1afb1f066 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.147840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4fdda-cb84-414e-ba22-a2b1afb1f066 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:30.148318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4fdda-cb84-414e-ba22-a2b1afb1f066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.149888 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4fdda-cb84-414e-ba22-a2b1afb1f066 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.160857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 163/308] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:30.162492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3904-09b5-44bc-bf78-3226e9e83c89 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.162818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3904-09b5-44bc-bf78-3226e9e83c89 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.163094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3904-09b5-44bc-bf78-3226e9e83c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.183387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.183920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-60ea3904-09b5-44bc-bf78-3226e9e83c89 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:30.184027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.184267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.184534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] PATH_INFO: `/v3/groups` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.185104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-60ea3904-09b5-44bc-bf78-3226e9e83c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:30.185197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.186588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.236635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:30.253689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 164/309] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:30.254583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea3904-09b5-44bc-bf78-3226e9e83c89 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.287008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 146/310] 10.222.0.49 () {60 vars in 1134 bytes} [Fri Oct 28 09:35:30 2022] POST /identity/v3/groups => generated 229 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:30.373739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea3904-09b5-44bc-bf78-3226e9e83c89 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.412568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.413577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.414086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.414626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] PATH_INFO: `/v3/users/f0f1573f9c2e4c60baf773b5e92e8898` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.431612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] RBAC: Authorizing `identity:get_user(user_id=f0f1573f9c2e4c60baf773b5e92e8898)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.433473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.435569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 165/311] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/users/f0f1573f9c2e4c60baf773b5e92e8898 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:30.443883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.530254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.556688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ec922-fc3e-42ae-8676-4b4b4c18ef28 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.586642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:30.593108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:30.593238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.593821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.594154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.594436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.595190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] RBAC: Adding query filter params (role.id=cebc95f212be431ea7e26e82669eefef, user.id=f0f1573f9c2e4c60baf773b5e92e8898, scope.system=all) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:30.600017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.600017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.602642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 147/312] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/role_assignments?user.id=f0f1573f9c2e4c60baf773b5e92e8898&scope.system=all&role.id=cebc95f212be431ea7e26e82669eefef => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:30.668515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244397-7bc8-49cd-a69a-9c5e0446f8de None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.708003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.708660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.708941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.709216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.722438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:30.727464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:30.728593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:30.729578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 166/313] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:30.734514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:30.846880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812709fb-ed04-4d67-aba0-10dd9dd2d7bf None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:30.880750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:30.881356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:30.881628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:30.881889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:30.882543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:30.882861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:30.884234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:30.892783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 148/314] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:30.898964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.007805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617539f5-9c0b-45a2-80f7-8da1749c9475 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.010156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.043581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07018261-d238-482c-a552-431aa1e323de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.044211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07018261-d238-482c-a552-431aa1e323de None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.044604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07018261-d238-482c-a552-431aa1e323de None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.044895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07018261-d238-482c-a552-431aa1e323de None admin] PATH_INFO: `/v3/users/b4f33d42471a426f9d58dbc8b88064fb` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.046112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07018261-d238-482c-a552-431aa1e323de None admin] RBAC: Authorizing `identity:get_user(user_id=b4f33d42471a426f9d58dbc8b88064fb)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.047593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07018261-d238-482c-a552-431aa1e323de None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.049187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 167/315] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:30 2022] GET /identity/v3/users/b4f33d42471a426f9d58dbc8b88064fb => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:31.054943 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.115095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.167512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049eb43-a5ac-4dbd-8243-6c90a3f58d49 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.203769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.204380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.204658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.204926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.276949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.278468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.335546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:31.381066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 149/316] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:31.391776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07018261-d238-482c-a552-431aa1e323de None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.490230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07018261-d238-482c-a552-431aa1e323de None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.523565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b1851-d9db-4e29-886c-90cdc1b995da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.524209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1851-d9db-4e29-886c-90cdc1b995da None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.524482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1851-d9db-4e29-886c-90cdc1b995da None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.524812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b1851-d9db-4e29-886c-90cdc1b995da None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.526046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b1851-d9db-4e29-886c-90cdc1b995da None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.527841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b1851-d9db-4e29-886c-90cdc1b995da None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.529868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 168/317] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:31.536048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:31.635078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e46fe-a1c4-47bf-b8d0-4a977bcd9f2c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:31.669426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b58920-1533-4453-be1f-d12914e78776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:31.670476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b58920-1533-4453-be1f-d12914e78776 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:31.670975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b58920-1533-4453-be1f-d12914e78776 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:31.671443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b58920-1533-4453-be1f-d12914e78776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:31.672350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b58920-1533-4453-be1f-d12914e78776 None admin] RBAC: Adding query filter params (role.id=cebc95f212be431ea7e26e82669eefef, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d, user.id=b4f33d42471a426f9d58dbc8b88064fb) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:31.672849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b58920-1533-4453-be1f-d12914e78776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:31.675132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b58920-1533-4453-be1f-d12914e78776 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:31.692889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 150/318] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:35:31 2022] GET /identity/v3/role_assignments?user.id=b4f33d42471a426f9d58dbc8b88064fb&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=cebc95f212be431ea7e26e82669eefef => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.234539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260916-b1c2-413d-a543-f8eb7fa521a9 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.234952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260916-b1c2-413d-a543-f8eb7fa521a9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.235125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260916-b1c2-413d-a543-f8eb7fa521a9 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.236595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 169/319] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:32.241546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e5493-5fc6-4309-92c5-8f9e1302638f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.241989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e5493-5fc6-4309-92c5-8f9e1302638f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.242080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e5493-5fc6-4309-92c5-8f9e1302638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.260026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-300e5493-5fc6-4309-92c5-8f9e1302638f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:32.261300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-300e5493-5fc6-4309-92c5-8f9e1302638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:32.275962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.328631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 151/320] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:32.595946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260916-b1c2-413d-a543-f8eb7fa521a9 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.626339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b737-4657-4c94-8830-dbda8937ef2d None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.626624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b737-4657-4c94-8830-dbda8937ef2d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.627095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99b737-4657-4c94-8830-dbda8937ef2d None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.628960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 152/321] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:32.633977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ede6-e232-49b4-828e-5abb66e82d86 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.634259 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ede6-e232-49b4-828e-5abb66e82d86 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.634530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44ede6-e232-49b4-828e-5abb66e82d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.640983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.653373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-da44ede6-e232-49b4-828e-5abb66e82d86 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:32.654701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-da44ede6-e232-49b4-828e-5abb66e82d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:32.712157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260916-b1c2-413d-a543-f8eb7fa521a9 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.729698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 153/322] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:32.753435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de8045-a8c6-4fdd-bcc4-5c0503708f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.754061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de8045-a8c6-4fdd-bcc4-5c0503708f92 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.754340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de8045-a8c6-4fdd-bcc4-5c0503708f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.754612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de8045-a8c6-4fdd-bcc4-5c0503708f92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.764891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de8045-a8c6-4fdd-bcc4-5c0503708f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-34de8045-a8c6-4fdd-bcc4-5c0503708f92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:32.770733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:32.771654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:32.772437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 170/323] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:32.777950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ede6-e232-49b4-828e-5abb66e82d86 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.810655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a879-5a39-4ae1-a8c0-13d3ca78ed92 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.810982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a879-5a39-4ae1-a8c0-13d3ca78ed92 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.811260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a879-5a39-4ae1-a8c0-13d3ca78ed92 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.813720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 171/324] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:32.819343 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239bfd-9dcd-404a-87ca-e2b154401b57 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.819855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239bfd-9dcd-404a-87ca-e2b154401b57 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.820441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239bfd-9dcd-404a-87ca-e2b154401b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.840476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c1239bfd-9dcd-404a-87ca-e2b154401b57 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:32.841935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c1239bfd-9dcd-404a-87ca-e2b154401b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:32.858425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.876554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44ede6-e232-49b4-828e-5abb66e82d86 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:32.912845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 172/325] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:32.913121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:32.913663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:32.914019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:32.914294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:32.914978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:32.915280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:32.916651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:32.926433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 154/326] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:32.932004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239bfd-9dcd-404a-87ca-e2b154401b57 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:32.961786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:32.998958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.032249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239bfd-9dcd-404a-87ca-e2b154401b57 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.068612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.069230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.069505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.069778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] PATH_INFO: `/v3/users/725bd3bbed5b474dbc98e73dcf745d71` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.070918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] RBAC: Authorizing `identity:get_user(user_id=725bd3bbed5b474dbc98e73dcf745d71)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.072367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.073925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 173/327] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/users/725bd3bbed5b474dbc98e73dcf745d71 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:33.079486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.102381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188a844-1097-4aab-ab75-53d90c8fde0a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.137753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.138626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.139084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.139583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.140822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.142493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.144230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 155/328] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:33.149700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.162984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.182957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.186642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa57b7-3c4a-490c-898a-84e44487e2c4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.219733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.220324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.220594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.220866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.221579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] RBAC: Adding query filter params (role.id=41c7907fa20b41d3a299d45128434e86, user.id=725bd3bbed5b474dbc98e73dcf745d71, scope.system=all) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:33.221883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.223356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.235261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 174/329] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/role_assignments?user.id=725bd3bbed5b474dbc98e73dcf745d71&scope.system=all&role.id=41c7907fa20b41d3a299d45128434e86 => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:33.244180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.253332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d358-b769-4dee-9bb5-3635ef990475 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.291835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.292494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.292739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.293007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] PATH_INFO: `/v3/groups` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.293658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.295322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.357212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7180693-128f-4391-a08f-f3fc694b4835 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.402777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 156/330] 10.222.0.49 () {60 vars in 1134 bytes} [Fri Oct 28 09:35:33 2022] POST /identity/v3/groups => generated 226 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:33.402962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.402962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.402962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.402962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.416917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:33.422428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:33.423590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:33.425376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 175/331] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:33.430369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.510915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.544533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25446be1-cde8-46b1-bce1-bbd2d3e5f499 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.580366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.580973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.581249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.581516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.582173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:33.582470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.583875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.592154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 157/332] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:33.598280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.617444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.703855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17489504-a620-42a0-bd6c-479efbdbd9d6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.738261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aeab1e-fe1c-43f1-ad09-c5639a1860c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.739149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeab1e-fe1c-43f1-ad09-c5639a1860c2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.739596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeab1e-fe1c-43f1-ad09-c5639a1860c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.739864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeab1e-fe1c-43f1-ad09-c5639a1860c2 None admin] PATH_INFO: `/v3/users/f0f1573f9c2e4c60baf773b5e92e8898` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.740988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeab1e-fe1c-43f1-ad09-c5639a1860c2 None admin] RBAC: Authorizing `identity:get_user(user_id=f0f1573f9c2e4c60baf773b5e92e8898)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.742431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeab1e-fe1c-43f1-ad09-c5639a1860c2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.744021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 176/333] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:33 2022] GET /identity/v3/users/f0f1573f9c2e4c60baf773b5e92e8898 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:33.749640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:33.863534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd8d3-d2ff-44a3-8544-5d07e0c7bfaa None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:33.896102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:33.903227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8d432-f023-4030-a714-a214ce119155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:33.903227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d432-f023-4030-a714-a214ce119155 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:33.903227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d432-f023-4030-a714-a214ce119155 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:33.903227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8d432-f023-4030-a714-a214ce119155 None admin] PATH_INFO: `/v3/system/users/f0f1573f9c2e4c60baf773b5e92e8898/roles/cebc95f212be431ea7e26e82669eefef` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:33.905787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8d432-f023-4030-a714-a214ce119155 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f0f1573f9c2e4c60baf773b5e92e8898, role_id=cebc95f212be431ea7e26e82669eefef)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:33.907213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8d432-f023-4030-a714-a214ce119155 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:33.988003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 158/334] 10.222.0.49 () {58 vars in 1334 bytes} [Fri Oct 28 09:35:33 2022] PUT /identity/v3/system/users/f0f1573f9c2e4c60baf773b5e92e8898/roles/cebc95f212be431ea7e26e82669eefef => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:36.205990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90aad9-2a55-4b22-974a-13286dc2dd61 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.207019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90aad9-2a55-4b22-974a-13286dc2dd61 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.207498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90aad9-2a55-4b22-974a-13286dc2dd61 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.209134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 177/335] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:36.214897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b29b-5ae5-4ccc-80cf-7acc3073cbdb None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.215787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b29b-5ae5-4ccc-80cf-7acc3073cbdb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.216277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b29b-5ae5-4ccc-80cf-7acc3073cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.265202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1194b29b-5ae5-4ccc-80cf-7acc3073cbdb None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:36.266862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1194b29b-5ae5-4ccc-80cf-7acc3073cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:36.354126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 159/336] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:36.532680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be481-47bb-4ebb-a866-f256778645d1 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.533835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be481-47bb-4ebb-a866-f256778645d1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.534310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679be481-47bb-4ebb-a866-f256778645d1 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.535861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 178/337] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:36.541629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540373fa-774a-48ea-9ecb-32861a97e072 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.542211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540373fa-774a-48ea-9ecb-32861a97e072 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.543639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540373fa-774a-48ea-9ecb-32861a97e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.566120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-540373fa-774a-48ea-9ecb-32861a97e072 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:36.567656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-540373fa-774a-48ea-9ecb-32861a97e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:36.625314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8f78-ebf9-4e99-8168-c0570efe78f9 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.625939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8f78-ebf9-4e99-8168-c0570efe78f9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.626409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8f78-ebf9-4e99-8168-c0570efe78f9 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.628211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 179/338] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:36.634449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558a35-2731-4e53-9b9c-9922ca8943b5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.634701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558a35-2731-4e53-9b9c-9922ca8943b5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.634990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558a35-2731-4e53-9b9c-9922ca8943b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.661916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 160/339] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:36.678639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a8558a35-2731-4e53-9b9c-9922ca8943b5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:36.679873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a8558a35-2731-4e53-9b9c-9922ca8943b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:36.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 180/340] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:36.807887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086db0-0f36-4459-925c-65bdb5a72c93 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.808454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086db0-0f36-4459-925c-65bdb5a72c93 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.808916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086db0-0f36-4459-925c-65bdb5a72c93 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.810445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 161/341] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:36.820592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558a35-2731-4e53-9b9c-9922ca8943b5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:36.824022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47d2e-b30d-4eca-a882-a6364512d387 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:36.824410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47d2e-b30d-4eca-a882-a6364512d387 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:36.824680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f47d2e-b30d-4eca-a882-a6364512d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:36.837507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:36.855700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-67f47d2e-b30d-4eca-a882-a6364512d387 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:36.856966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-67f47d2e-b30d-4eca-a882-a6364512d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:36.938982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:36.969324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 162/342] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:37.000287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8558a35-2731-4e53-9b9c-9922ca8943b5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.048619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.049295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.049574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.049853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.067619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:37.072456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:37.073313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:37.074089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 181/343] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:37.081595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47d2e-b30d-4eca-a882-a6364512d387 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.166778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.242766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f47d2e-b30d-4eca-a882-a6364512d387 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.312269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.312887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.313215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.313483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.314142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:37.314977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.315137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.316535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.336725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 163/344] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:37.344198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.372196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f5c3d-6531-4e78-840a-2362c97b8e01 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.444224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.450683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.450683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.450683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.451028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.474695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:37.478694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:37.479990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 182/345] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:37.480784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.526701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd4e8c-bf90-44d6-bc5b-aaab9c4a50f8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.569075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.570320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.570605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.570923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.621979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bc617-82d4-4d3e-8d97-2dca5a3070e7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.651911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.653444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:37.661121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.661806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.662088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.662358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.664303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.676753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:37.688014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:37.690216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:37.692180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 183/346] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:37.696606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.736016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:37.807121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 164/347] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:37.808060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.850367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc8bfc-f7fd-490d-9bd3-510f9bfbed9f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.900052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.901211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.901635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.901900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.915580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:37.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:37.923404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:37.924223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 184/348] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:37.925346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:37.951204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a397b4a-9ec3-4ccc-8ec9-fe255b3bd847 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:37.994504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:37.995145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:37.995425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:37.995690 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:37.996353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:37.998363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:37.999434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.000650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.012921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 165/349] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:38.014186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.033763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.066797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57051864-6d75-4018-bf0b-aefff4672d25 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.109830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d4329-bda9-4aa6-81a9-8705411558c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.110456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d4329-bda9-4aa6-81a9-8705411558c4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.111653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d4329-bda9-4aa6-81a9-8705411558c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.111653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d4329-bda9-4aa6-81a9-8705411558c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.111841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d4329-bda9-4aa6-81a9-8705411558c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:38.112042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d4329-bda9-4aa6-81a9-8705411558c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.113480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d4329-bda9-4aa6-81a9-8705411558c4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.126109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 185/350] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:38.127991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38b3c-78cb-4ee9-b348-4294d8b854ee None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.128277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38b3c-78cb-4ee9-b348-4294d8b854ee None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.128546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c38b3c-78cb-4ee9-b348-4294d8b854ee None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.129755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 186/351] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:38.130461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38b3c-78cb-4ee9-b348-4294d8b854ee None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.151433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3cf53-ca10-4724-b63c-d3b6ce04b0f2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.189875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.190546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.190851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.191118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.192416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.194015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.195606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 166/352] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:38.196107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.250310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c38b3c-78cb-4ee9-b348-4294d8b854ee None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.267614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.289207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.293976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.294868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.295147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.295413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.296130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:38.296828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.300664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.310041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 187/353] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:38.310734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.316585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db9a2c-94d5-43a1-a877-27e763381e0d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.357322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb486de-7d12-4653-bf3a-e08d6ffc6ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.357925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb486de-7d12-4653-bf3a-e08d6ffc6ba9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.358197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb486de-7d12-4653-bf3a-e08d6ffc6ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.358465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb486de-7d12-4653-bf3a-e08d6ffc6ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.437440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb486de-7d12-4653-bf3a-e08d6ffc6ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.439096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb486de-7d12-4653-bf3a-e08d6ffc6ba9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.441519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d135145-a293-4c96-ba4a-7504dd2d630d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.481647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.482326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.482604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.482921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.525393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.539588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.550404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 167/354] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:38.551702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bb80-0e9c-4c28-a33d-1b0d4392b86a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.551989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bb80-0e9c-4c28-a33d-1b0d4392b86a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.552264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bb80-0e9c-4c28-a33d-1b0d4392b86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.563970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.565724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.571994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b075bb80-0e9c-4c28-a33d-1b0d4392b86a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:38.573181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b075bb80-0e9c-4c28-a33d-1b0d4392b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:38.646100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 168/355] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:38.647248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa435-2742-492d-9247-da451df1ff67 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.647532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa435-2742-492d-9247-da451df1ff67 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.647807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa435-2742-492d-9247-da451df1ff67 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.649048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 169/356] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:38.650406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa435-2742-492d-9247-da451df1ff67 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.696677 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 188/357] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:38.697530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.793024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa435-2742-492d-9247-da451df1ff67 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.801254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.805194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:38.830561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711cad6-64bc-4a92-a7f9-d18f6350fa3f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.839443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.840159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.840518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.840708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.852174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.853655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.855331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 170/358] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:38.856101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:38.872526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca25af6-46ca-4b3a-bf5e-ec4792fd98ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:38.873512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca25af6-46ca-4b3a-bf5e-ec4792fd98ec None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.874021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca25af6-46ca-4b3a-bf5e-ec4792fd98ec None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.874480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca25af6-46ca-4b3a-bf5e-ec4792fd98ec None admin] PATH_INFO: `/v3/users/f0f1573f9c2e4c60baf773b5e92e8898` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.875945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca25af6-46ca-4b3a-bf5e-ec4792fd98ec None admin] RBAC: Authorizing `identity:get_user(user_id=f0f1573f9c2e4c60baf773b5e92e8898)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:38.878778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca25af6-46ca-4b3a-bf5e-ec4792fd98ec None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:38.880500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 189/359] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/users/f0f1573f9c2e4c60baf773b5e92e8898 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:38.881692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7bbd-9176-4d2c-ab8b-12185eb13bec None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:38.881974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7bbd-9176-4d2c-ab8b-12185eb13bec None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:38.882246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c7bbd-9176-4d2c-ab8b-12185eb13bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:38.903366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-283c7bbd-9176-4d2c-ab8b-12185eb13bec None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:38.904549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-283c7bbd-9176-4d2c-ab8b-12185eb13bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:38.976301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddb56d-3a91-41f5-aa83-00fa45fac748 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:38.994485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 190/360] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:38.995189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7bbd-9176-4d2c-ab8b-12185eb13bec None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.012535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.013161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.013432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.013698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.014890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.016330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.017964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 171/361] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.018739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.076101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.094690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.127358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c7bbd-9176-4d2c-ab8b-12185eb13bec None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.147502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baac04-de5c-49d1-8596-e6c3135c2be9 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.169160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.169795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.170065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.170331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.171622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.173172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.175664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 191/362] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:38 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.176235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.197304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.197908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.198190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.198461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.200193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.200504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.201934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.207898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 172/363] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=41c7907fa20b41d3a299d45128434e86 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.208698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.324159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4f60e-8318-46b2-8e57-4f2203032057 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.340121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9500b-e5cf-4fef-a24e-b788b3885972 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.344088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.373777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.374397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.374697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.374973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.375717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] RBAC: Adding query filter params (role.id=cebc95f212be431ea7e26e82669eefef, user.id=f0f1573f9c2e4c60baf773b5e92e8898, scope.system=all) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.376018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.377506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.392393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.393040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.393313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.393579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.394729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 192/364] 10.222.0.49 () {56 vars in 1308 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/role_assignments?user.id=f0f1573f9c2e4c60baf773b5e92e8898&scope.system=all&role.id=cebc95f212be431ea7e26e82669eefef => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.395432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.399369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.411698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:39.419509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:39.420495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:39.421298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:39.424893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 173/365] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:39.425969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.544135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77628ac7-30ea-4c71-8439-ce82922a5222 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.561565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941d7cf-a15e-4ea5-ba6d-0f54d9341196 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.592550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.593806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.594366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.594917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.596756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.598345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.600444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 193/366] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.601553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.608834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.609472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.609751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.610065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.611801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.613358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.615361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 174/367] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.617230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.656110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.696097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.740901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0bf8b-f2ec-4c28-bf30-29be81766d12 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.745254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537125eb-6eaa-4b38-8c5c-7ffff90c9e90 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.786023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.786225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.786693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.786905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.787003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.787176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.787278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.787439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.788126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.788422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.789795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.798101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 175/368] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.799286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.803320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:39.808684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:39.809572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:39.810375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 194/369] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:39.811047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.915528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.922220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169af2-36f4-4645-b1e7-0fb36f270f6a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.948548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85382d7-02e0-4eb2-a820-53f6e16cefe5 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:39.960825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.961813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.962289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.962750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.963614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.964065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.966750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:39.974352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 176/370] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:39.975517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:39.981481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:39.988263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:39.988979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:39.989309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:39.993969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:39.993969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:39.993969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:39.993969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.000876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 195/371] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=41c7907fa20b41d3a299d45128434e86 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:40.009150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.120230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fccba-161a-4bea-8014-3150651ee124 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.168282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.168850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.169415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.169696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.231343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.269042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a039e5-1602-47db-8d4f-fe14df72c786 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.291855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.293397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.314747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.316188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.316963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.317439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.319011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:40.319550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.321115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.333933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 196/372] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:40.337166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.454138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.462131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 177/373] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:40.468266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.529670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.568633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e67843-b8cc-4531-82f8-f062d62249db None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.575081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6276fc9-dea3-47f5-b0da-083fafacc1f6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.613515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.614516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.615051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.615524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.616862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.618532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.620728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 178/374] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:40.626261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.636459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.637818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.638324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.638862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.768282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34ab82-01c8-4dc4-b6b0-e02f2819afb6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:40.802971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:40.804821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:40.805458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:40.805738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:40.806010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:40.807227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.808686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.810330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 179/375] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:40.817442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:40.818930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:40.821754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:40.935141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.015002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 197/376] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:41.020080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99614943-2154-4c7e-9e3f-e35ea4c184cd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.020480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.063897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.065444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.065939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.066399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.067467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:41.067986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.069658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.083039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 180/377] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:40 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:41.210976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47665-7f86-4c1a-96d3-ad36cceef44d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.255706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.256812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.257282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.257772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] PATH_INFO: `/v3/projects/713caf85a4104b85af4a0b40b1b96328` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.259167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=713caf85a4104b85af4a0b40b1b96328)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.260778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.262943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 198/378] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/projects/713caf85a4104b85af4a0b40b1b96328 => generated 344 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:41.268200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.328865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.371104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ff66e-8bd4-4457-a279-6e4941c39626 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.417642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bb3ac-7ab0-4e0a-8606-b85797d6662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.418324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bb3ac-7ab0-4e0a-8606-b85797d6662d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.418603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bb3ac-7ab0-4e0a-8606-b85797d6662d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.418899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bb3ac-7ab0-4e0a-8606-b85797d6662d None admin] PATH_INFO: `/v3/groups/31141c0f45bb43e5bf3b5f84ace4db67` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.427250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bb3ac-7ab0-4e0a-8606-b85797d6662d None admin] RBAC: Authorizing `identity:get_group(group_id=31141c0f45bb43e5bf3b5f84ace4db67)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.428699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bb3ac-7ab0-4e0a-8606-b85797d6662d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.430683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 181/379] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/groups/31141c0f45bb43e5bf3b5f84ace4db67 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:41.436247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:41.466115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:41.553595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5d07a-4fbf-4190-b548-81fb3951b2d2 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:41.599414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727349b-af11-4f89-b311-9452983d5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:41.600030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727349b-af11-4f89-b311-9452983d5e39 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.600253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727349b-af11-4f89-b311-9452983d5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.600491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727349b-af11-4f89-b311-9452983d5e39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.601211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727349b-af11-4f89-b311-9452983d5e39 None admin] RBAC: Adding query filter params (group.id=31141c0f45bb43e5bf3b5f84ace4db67, role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=713caf85a4104b85af4a0b40b1b96328) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:41.601507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727349b-af11-4f89-b311-9452983d5e39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:41.602960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727349b-af11-4f89-b311-9452983d5e39 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:41.609782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 199/380] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:41 2022] GET /identity/v3/role_assignments?group.id=31141c0f45bb43e5bf3b5f84ace4db67&scope.project.id=713caf85a4104b85af4a0b40b1b96328&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:41.796737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b92e-ddaa-487d-935a-17099ff7a4b2 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.797253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b92e-ddaa-487d-935a-17099ff7a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.797253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b92e-ddaa-487d-935a-17099ff7a4b2 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.798999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 182/381] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:41.804592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2d41-0eef-4d08-9338-188501b22e0f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:41.804894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2d41-0eef-4d08-9338-188501b22e0f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:41.805135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c2d41-0eef-4d08-9338-188501b22e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:41.824820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-799c2d41-0eef-4d08-9338-188501b22e0f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:41.826056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-799c2d41-0eef-4d08-9338-188501b22e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:41.901180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 200/382] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:42.170143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b92e-ddaa-487d-935a-17099ff7a4b2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.294423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b92e-ddaa-487d-935a-17099ff7a4b2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.325939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.341965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.342594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.342947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.343215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.355727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:42.362197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:42.363102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:42.363872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 183/383] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:42.371760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2d41-0eef-4d08-9338-188501b22e0f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.395335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.509076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c2d41-0eef-4d08-9338-188501b22e0f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.543333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26053ab9-c05c-4f4b-88b9-e3a9fc6a0dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.543994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26053ab9-c05c-4f4b-88b9-e3a9fc6a0dc5 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.544271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26053ab9-c05c-4f4b-88b9-e3a9fc6a0dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.544536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26053ab9-c05c-4f4b-88b9-e3a9fc6a0dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.545190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26053ab9-c05c-4f4b-88b9-e3a9fc6a0dc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:42.545486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26053ab9-c05c-4f4b-88b9-e3a9fc6a0dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.546888 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26053ab9-c05c-4f4b-88b9-e3a9fc6a0dc5 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.560412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 201/384] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:42.564988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.699856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6d9e-00a4-464b-bf01-5d8e204fa43d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.700813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6d9e-00a4-464b-bf01-5d8e204fa43d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.701301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6d9e-00a4-464b-bf01-5d8e204fa43d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.702854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 202/385] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:42.709392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2dbac-d1f4-482d-8ff7-034e0cc93fb4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.710125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2dbac-d1f4-482d-8ff7-034e0cc93fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.710719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2dbac-d1f4-482d-8ff7-034e0cc93fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.728925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb527b-b765-468a-b144-d81a4fed735e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:42.747716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-71d2dbac-d1f4-482d-8ff7-034e0cc93fb4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:42.749069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-71d2dbac-d1f4-482d-8ff7-034e0cc93fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:42.802132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:42.802811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.803014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.803279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.804415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:42.807940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:42.809971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 184/386] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:42.816828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:42.860078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 203/387] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:42.861749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89549c-ca3f-48f1-8491-bed7ca0cb0c2 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.862224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89549c-ca3f-48f1-8491-bed7ca0cb0c2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.862713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89549c-ca3f-48f1-8491-bed7ca0cb0c2 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.864188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 204/388] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:42.870854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b723-b66d-42ad-933a-9b140e0aac39 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:42.871989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b723-b66d-42ad-933a-9b140e0aac39 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:42.872454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b723-b66d-42ad-933a-9b140e0aac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:42.905436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-32e1b723-b66d-42ad-933a-9b140e0aac39 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:42.908367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-32e1b723-b66d-42ad-933a-9b140e0aac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:42.913683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:42.917644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.003985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7ccb-01bf-4e70-8c2b-043f22a535da None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.046785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 205/389] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:43.066588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.067242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.067517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.067781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.068898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.070334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.073160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 185/390] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:42 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:43.077886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b723-b66d-42ad-933a-9b140e0aac39 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.166870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.194249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b723-b66d-42ad-933a-9b140e0aac39 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.232730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.233777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.234263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.234768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/groups/201e7d3377b44df99212aad76fc04928/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.237291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f802c6aa541e18d16cf2e89d37d7d, group_id=201e7d3377b44df99212aad76fc04928, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.239083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.327143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.332605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 206/391] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 09:35:43 2022] PUT /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/groups/201e7d3377b44df99212aad76fc04928/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:43.337203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb890-8159-43d4-83c7-c5c2d6e49d1b None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.356692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.382454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.383384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.383830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.384247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.398248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.400450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:43.406066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:43.407410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:43.408340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:43.414475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 186/392] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:43.415480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.539074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae7f69-8dbe-4922-a0d0-2830df5d9229 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.586929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.587980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.588497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.588910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.601782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a0931-a635-46cb-a2d1-54a29b3532e0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.603897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:43.610204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:43.611881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:43.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:43.615369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 207/393] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:43.622307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.643906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255416b-6c78-47b1-be20-355a914ff829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.644660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255416b-6c78-47b1-be20-355a914ff829 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.645185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255416b-6c78-47b1-be20-355a914ff829 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.645596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255416b-6c78-47b1-be20-355a914ff829 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.646698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255416b-6c78-47b1-be20-355a914ff829 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:43.647175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255416b-6c78-47b1-be20-355a914ff829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.648662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255416b-6c78-47b1-be20-355a914ff829 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.659466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 187/394] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:43.661289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120593-f72b-4358-9392-b69527c204f6 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.661574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120593-f72b-4358-9392-b69527c204f6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.662106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3120593-f72b-4358-9392-b69527c204f6 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.663984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 188/395] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:43.664983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120593-f72b-4358-9392-b69527c204f6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.711294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.725328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:43.760778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f934bdb-2dd6-4e3b-8676-8c2df634d6cf None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.799456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3120593-f72b-4358-9392-b69527c204f6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:43.808607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af65a37-e3d8-42c4-bf26-71bc97c02050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.809969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af65a37-e3d8-42c4-bf26-71bc97c02050 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.810455 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af65a37-e3d8-42c4-bf26-71bc97c02050 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.811245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af65a37-e3d8-42c4-bf26-71bc97c02050 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.812428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af65a37-e3d8-42c4-bf26-71bc97c02050 None admin] RBAC: Adding query filter params (name=member) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:43.812935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af65a37-e3d8-42c4-bf26-71bc97c02050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.814558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af65a37-e3d8-42c4-bf26-71bc97c02050 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.826924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 208/396] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:43.828807 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d856-b981-40cb-8d4c-a763b7892aec None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.829725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d856-b981-40cb-8d4c-a763b7892aec None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.830473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8d856-b981-40cb-8d4c-a763b7892aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.837265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:43.837878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:43.838096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:43.838360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:43.839662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:43.841968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:43.843875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 189/397] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:43.844725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.854717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-aae8d856-b981-40cb-8d4c-a763b7892aec None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:43.856825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-aae8d856-b981-40cb-8d4c-a763b7892aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:43.937352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 209/398] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:43.938205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8d856-b981-40cb-8d4c-a763b7892aec None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:43.997256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3091-e6fc-4890-a8d6-8cf2ec4ac4a4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.004903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.016579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.055997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8d856-b981-40cb-8d4c-a763b7892aec None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.065081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.065733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.066012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.066282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.069010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.070545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.072432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 190/399] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:44.077928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.095029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.096488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.097153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.097672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.099112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.102383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.103242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 210/400] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:43 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:44.108519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.235188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced5c0-9c20-41dc-909e-ef09f2fff8d5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.277246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b95a-59ab-41be-8a55-aba307295f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.278210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b95a-59ab-41be-8a55-aba307295f7a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.278484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b95a-59ab-41be-8a55-aba307295f7a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.278778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b95a-59ab-41be-8a55-aba307295f7a None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.279912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46b95a-59ab-41be-8a55-aba307295f7a None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.281388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46b95a-59ab-41be-8a55-aba307295f7a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.283827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 191/401] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:44.284867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062852b-ac23-4859-b534-5afb1e3df67a None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.285274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062852b-ac23-4859-b534-5afb1e3df67a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.285541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062852b-ac23-4859-b534-5afb1e3df67a None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.287081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 192/402] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:44.287664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062852b-ac23-4859-b534-5afb1e3df67a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.307046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d883c-ea6d-403d-ba4a-968bffceb100 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.328307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.337360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.343067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.343727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.343995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.344253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/groups/201e7d3377b44df99212aad76fc04928/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.347137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] RBAC: Authorizing `identity:create_grant(project_id=34c4b4b91bf74ea59cd59644b04803ed, group_id=201e7d3377b44df99212aad76fc04928, role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.348486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.389650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062852b-ac23-4859-b534-5afb1e3df67a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.418712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 211/403] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 09:35:44 2022] PUT /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/groups/201e7d3377b44df99212aad76fc04928/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:44.418712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.432694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af86042-e89b-420f-b718-12d911cd9038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.433386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af86042-e89b-420f-b718-12d911cd9038 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.433665 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af86042-e89b-420f-b718-12d911cd9038 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.433929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af86042-e89b-420f-b718-12d911cd9038 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.446009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af86042-e89b-420f-b718-12d911cd9038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-5af86042-e89b-420f-b718-12d911cd9038 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:44.451319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:44.458131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 193/404] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:44.459003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4b590-7cf8-46e5-a235-0bd2efd9d273 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.459749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4b590-7cf8-46e5-a235-0bd2efd9d273 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.459749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4b590-7cf8-46e5-a235-0bd2efd9d273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.476502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-96c4b590-7cf8-46e5-a235-0bd2efd9d273 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:44.477740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-96c4b590-7cf8-46e5-a235-0bd2efd9d273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:44.554982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 194/405] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:44.555921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4b590-7cf8-46e5-a235-0bd2efd9d273 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.562472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d01129-7187-49a4-bc11-66d4d51539da None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.592046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.608583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.609942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.610449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.611035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/groups/201e7d3377b44df99212aad76fc04928/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.614246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] RBAC: Authorizing `identity:create_grant(project_id=34c4b4b91bf74ea59cd59644b04803ed, group_id=201e7d3377b44df99212aad76fc04928, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.616540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.670613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4b590-7cf8-46e5-a235-0bd2efd9d273 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.722518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.722772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 212/406] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 09:35:44 2022] PUT /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed/groups/201e7d3377b44df99212aad76fc04928/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:44.724262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.724743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.725327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.730701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:44.731480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.733133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.742898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 195/407] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:44.752558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.821243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:44.903234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ad89a-2302-4cbc-aa4c-9ef9d39bd71a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:44.953417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:44.953952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:44.953952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:44.954112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:44.954494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:44.955590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:44.957035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:44.958695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 213/408] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:44.967427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.105701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa02ea3-ee3c-45b7-82a2-36dbdd85e685 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.115696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.132576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.136200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614247b-ad92-484f-869d-6475a6318f2a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.159432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.159992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.160277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.160550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.161820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.164505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.166329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 214/409] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:45.172098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.200653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.201293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.201574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.201843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.218903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:45.225029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:45.225872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:45.226954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 196/410] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:45.236103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.309389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a69cb2-a9ed-4c0c-8e84-f4cc51c3dbe4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.352320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.352983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.353261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.353528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/groups/201e7d3377b44df99212aad76fc04928/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.358887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f802c6aa541e18d16cf2e89d37d7d, group_id=201e7d3377b44df99212aad76fc04928, role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.360332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.406766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bab3e1-45dd-4bd3-ae20-d33ff7e64e45 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.453202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 215/411] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 09:35:45 2022] PUT /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d/groups/201e7d3377b44df99212aad76fc04928/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:35:45.453897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.454562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.454863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.455131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.455904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:45.456209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.457690 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.469434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 197/412] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:45.476070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.524948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.610226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4fdbb-0d9a-4225-822e-3c1fb732a4b5 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.655540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.656174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.656447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.656716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] PATH_INFO: `/v3/groups/31141c0f45bb43e5bf3b5f84ace4db67` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.658397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] RBAC: Authorizing `identity:get_group(group_id=31141c0f45bb43e5bf3b5f84ace4db67)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.659870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.661433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 216/413] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:45 2022] GET /identity/v3/groups/31141c0f45bb43e5bf3b5f84ace4db67 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:45.666935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.687361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.777424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c33e6e-d2aa-4009-9384-e2bafc4345d7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.817544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af34d1e-643e-4bb0-a2f2-dcf4df275dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.818196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34d1e-643e-4bb0-a2f2-dcf4df275dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.818507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34d1e-643e-4bb0-a2f2-dcf4df275dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.818808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af34d1e-643e-4bb0-a2f2-dcf4df275dc8 None admin] PATH_INFO: `/v3/projects/713caf85a4104b85af4a0b40b1b96328` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.819991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af34d1e-643e-4bb0-a2f2-dcf4df275dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=713caf85a4104b85af4a0b40b1b96328)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.821512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af34d1e-643e-4bb0-a2f2-dcf4df275dc8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:45.823790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 198/414] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:45 2022] GET /identity/v3/projects/713caf85a4104b85af4a0b40b1b96328 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:45.830387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:45.938891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a89956-2de7-43a3-954c-de741f9a0c5a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:45.941335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:45.956151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02590ed-b123-4615-bccc-c80aaf5aed97 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.962605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02590ed-b123-4615-bccc-c80aaf5aed97 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.962605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02590ed-b123-4615-bccc-c80aaf5aed97 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.962605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 199/415] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:45.978724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1c7d-f841-4ca6-8bbc-75a51119f8ba None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.978724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1c7d-f841-4ca6-8bbc-75a51119f8ba None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.978724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f1c7d-f841-4ca6-8bbc-75a51119f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.985695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:45.986767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:45.986767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:45.986946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] PATH_INFO: `/v3/projects/713caf85a4104b85af4a0b40b1b96328/groups/31141c0f45bb43e5bf3b5f84ace4db67/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:45.991147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=713caf85a4104b85af4a0b40b1b96328, group_id=31141c0f45bb43e5bf3b5f84ace4db67, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:45.992938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.006839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-be9f1c7d-f841-4ca6-8bbc-75a51119f8ba None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:46.008066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-be9f1c7d-f841-4ca6-8bbc-75a51119f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:46.074343 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 217/416] 10.222.0.49 () {58 vars in 1442 bytes} [Fri Oct 28 09:35:45 2022] PUT /identity/v3/projects/713caf85a4104b85af4a0b40b1b96328/groups/31141c0f45bb43e5bf3b5f84ace4db67/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:35:46.087024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 200/417] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:46.442278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.575346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467980-dd8d-4ecb-aad3-0bf2f29fa1a2 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.624520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.625516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.626024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.627059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.637269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:46.642289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:46.643363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:46.644143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:46.646621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 218/418] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:46.654181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f1c7d-f841-4ca6-8bbc-75a51119f8ba None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.694751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.783297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f1c7d-f841-4ca6-8bbc-75a51119f8ba None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:46.839949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381e18b-9cc9-4e43-90be-7ae17fce8f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:46.840567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e18b-9cc9-4e43-90be-7ae17fce8f91 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.840848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e18b-9cc9-4e43-90be-7ae17fce8f91 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.841179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e18b-9cc9-4e43-90be-7ae17fce8f91 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:46.841851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381e18b-9cc9-4e43-90be-7ae17fce8f91 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:46.842151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381e18b-9cc9-4e43-90be-7ae17fce8f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:46.843553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381e18b-9cc9-4e43-90be-7ae17fce8f91 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:46.858189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 201/419] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:46.864482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:46.918280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:46.998243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ac09-b75a-475e-9792-9f2c96792fdc None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:46.998785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ac09-b75a-475e-9792-9f2c96792fdc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:46.998785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617ac09-b75a-475e-9792-9f2c96792fdc None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.000188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 202/420] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:47.005363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8491-7e08-4bee-9b28-c877992caed1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.005877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8491-7e08-4bee-9b28-c877992caed1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.006354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8491-7e08-4bee-9b28-c877992caed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.027170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4e3f8491-7e08-4bee-9b28-c877992caed1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:47.028643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4e3f8491-7e08-4bee-9b28-c877992caed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:47.035344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8686d-b977-4f31-bf8d-c18e58a4c6a0 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.088772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa1eb0-9bd7-4eb2-a29a-8ee88d25d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.089387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa1eb0-9bd7-4eb2-a29a-8ee88d25d90d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.089669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa1eb0-9bd7-4eb2-a29a-8ee88d25d90d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.089937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa1eb0-9bd7-4eb2-a29a-8ee88d25d90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.161481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 203/421] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:47.200129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa1eb0-9bd7-4eb2-a29a-8ee88d25d90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.201597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa1eb0-9bd7-4eb2-a29a-8ee88d25d90d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.227740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.308603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 219/422] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:47.315396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8491-7e08-4bee-9b28-c877992caed1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.328803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.445404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8491-7e08-4bee-9b28-c877992caed1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.476018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396cb3-3553-4dfa-8cf3-b91839bf0a5c None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.476309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396cb3-3553-4dfa-8cf3-b91839bf0a5c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.476573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396cb3-3553-4dfa-8cf3-b91839bf0a5c None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.477907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 220/423] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:47.481403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.482061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.482337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.482604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.482841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9b93-210c-454c-ad43-a16181268244 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.483155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9b93-210c-454c-ad43-a16181268244 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.483384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9b93-210c-454c-ad43-a16181268244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.483747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.485264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.487251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 204/424] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:47.492472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.502167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-640b9b93-210c-454c-ad43-a16181268244 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:47.503394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-640b9b93-210c-454c-ad43-a16181268244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:47.577528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 221/425] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:47.588873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.632095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca469e-4824-4da5-82c6-03e00bb7963a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.676167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9b93-210c-454c-ad43-a16181268244 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.683824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.684463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.684742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.685014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.686121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.687610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 205/426] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:47.695233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.779129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:47.824193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9b93-210c-454c-ad43-a16181268244 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.844401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75136-9683-4077-87c6-51d4a71a9733 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:47.860949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.861838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.862331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.862880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.883860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:47.889622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:47.890553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:47.891407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:47.893074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 222/427] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:47.898396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:47.915287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:47.916206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:47.917058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:47.917533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:47.918461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:47.919296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:47.921044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:47.929029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 206/428] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=41c7907fa20b41d3a299d45128434e86 => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:47.971021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.001104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.035159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9d781-9098-4dbc-8d49-e3cb30189450 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.053076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.082337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.083236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.083515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.083859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.084483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:48.084787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.086214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.111407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 223/429] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:48.118473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.186881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a0ca-6bbd-4367-8e10-2df9407b9471 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.229003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.229520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.229792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.230055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.242510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:48.247958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:48.248842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:48.249638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 207/430] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:48.258437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.258764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1232612-a80e-4ef2-9102-745adff8ec63 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.295394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.296305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.296720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.297109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.336495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.351830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.381477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.381477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.381919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a38bf-c0dc-4842-8433-b3ad4ddb59c1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.431773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.432387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.432659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.432922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.433749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] RBAC: Adding query filter params (name=member) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:48.434147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.435555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.445148 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 208/431] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:48.450519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.494979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 224/432] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:35:48.502841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.581382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b278423-5860-49bf-a7bb-22c29a4bd416 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.587836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.610055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956f9e-a77a-4b82-91b1-d92a13d9da08 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.616490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.624218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.624942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.625224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.625491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.645434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8bfe6-90e6-433a-88a9-581b04f71f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.645979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8bfe6-90e6-433a-88a9-581b04f71f63 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.646250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8bfe6-90e6-433a-88a9-581b04f71f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.646513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8bfe6-90e6-433a-88a9-581b04f71f63 None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8bfe6-90e6-433a-88a9-581b04f71f63 None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.649088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8bfe6-90e6-433a-88a9-581b04f71f63 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.655445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 225/433] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:48.655445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856604ca-f7c7-470a-b076-856ecd593820 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.655445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856604ca-f7c7-470a-b076-856ecd593820 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.655445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856604ca-f7c7-470a-b076-856ecd593820 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.655445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 226/434] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:48.659003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856604ca-f7c7-470a-b076-856ecd593820 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.703194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.705191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.758581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856604ca-f7c7-470a-b076-856ecd593820 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.791401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073a2d3-89f2-4432-a6eb-cf6c562d72d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.792014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073a2d3-89f2-4432-a6eb-cf6c562d72d6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.792283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073a2d3-89f2-4432-a6eb-cf6c562d72d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.792548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073a2d3-89f2-4432-a6eb-cf6c562d72d6 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.793623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073a2d3-89f2-4432-a6eb-cf6c562d72d6 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.795057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073a2d3-89f2-4432-a6eb-cf6c562d72d6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.796932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 227/435] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:48.798132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44304-1e59-4089-ae0f-29b7d0b4b66b None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.798406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44304-1e59-4089-ae0f-29b7d0b4b66b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.798680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e44304-1e59-4089-ae0f-29b7d0b4b66b None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.802738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 228/436] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:48.802738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359d54-8cf5-4693-bb8c-69ad0e76a90c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.802738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359d54-8cf5-4693-bb8c-69ad0e76a90c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.802738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e359d54-8cf5-4693-bb8c-69ad0e76a90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.803053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 209/437] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:35:48.806878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:48.821121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-8e359d54-8cf5-4693-bb8c-69ad0e76a90c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:48.822278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8e359d54-8cf5-4693-bb8c-69ad0e76a90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:48.829952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.835715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:48.886175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 229/438] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:48.887493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c798c-1586-46cc-91c3-22fc7b7dffad None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.887775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c798c-1586-46cc-91c3-22fc7b7dffad None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.888033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c798c-1586-46cc-91c3-22fc7b7dffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.906519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-928c798c-1586-46cc-91c3-22fc7b7dffad None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:48.908229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-928c798c-1586-46cc-91c3-22fc7b7dffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:48.909398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b272-59dd-4f10-a0f2-fac13805e3ff None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:48.943789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:48.944385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:48.944658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:48.944921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:48.945635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:48.945932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:48.947373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:48.952968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 210/439] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:48.953724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.002704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 230/440] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:49.073629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.082253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff8e9f-69c5-42d8-9449-b4af2869e1a0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.119938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.120575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.120878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.121154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] PATH_INFO: `/v3/projects/34c4b4b91bf74ea59cd59644b04803ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.122293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] RBAC: Authorizing `identity:get_project(project_id=34c4b4b91bf74ea59cd59644b04803ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.123775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.125587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 211/441] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:48 2022] GET /identity/v3/projects/34c4b4b91bf74ea59cd59644b04803ed => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:49.131683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c798c-1586-46cc-91c3-22fc7b7dffad None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.164408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.215334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.257193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c798c-1586-46cc-91c3-22fc7b7dffad None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.280316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b91cbb-6b1e-47ad-b712-5d4899213aec None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.294992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.295614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.295884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.296196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.297220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.298713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.300399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 231/442] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:49.305996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.316028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.316712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.316991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.317260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.327558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:49.332982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:49.333822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:49.334613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 212/443] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:49.335761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.359243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.402584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f06550-a7e7-43da-ad54-eb5d269c0c50 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.433623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec9d00-ceee-4021-bdbf-5745d11c801a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.436141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.436802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.437083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.437347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.438061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=41c7907fa20b41d3a299d45128434e86, scope.project.id=34c4b4b91bf74ea59cd59644b04803ed) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:49.438360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.440366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.445967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 232/444] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=34c4b4b91bf74ea59cd59644b04803ed&role.id=41c7907fa20b41d3a299d45128434e86 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:49.446975 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.460023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.469267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.469926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.470205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.470477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.483339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:49.489009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:49.489978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:49.490957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 213/445] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:49.496043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.578730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5f47a-e12e-47e7-ab93-aba08fa84380 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.590642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.611187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba5c4-bd08-4964-88df-fe52e060da2c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.617633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.618239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.620015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.620015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.620015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:49.620015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.621154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.632128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 233/446] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:49.638530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.648420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.649255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.650133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.650910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.651576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:49.651876 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.653259 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.662618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 214/447] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:49.668157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:49.725641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.765089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de5024-f46d-444e-9db7-723dc533a850 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.788245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688d8df-d26f-49d5-893f-2c0621962f21 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:49.811593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.812198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.812476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.812739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.827219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:49.827826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:49.828104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:49.828374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:49.845625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:49.889861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.891360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.903705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:49.905159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:49.963644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.007992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 234/448] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:50.013665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.018012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 215/449] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 09:35:50.023651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.077410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.129447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444681-a87a-4666-ad00-2552adab2091 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.138933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ff2c-0093-4ed8-85ac-ba1b505b4a39 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.165990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.166610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.166911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.167175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] PATH_INFO: `/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.168263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] RBAC: Authorizing `identity:get_project(project_id=2b4f802c6aa541e18d16cf2e89d37d7d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.169693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.171324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 235/450] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/projects/2b4f802c6aa541e18d16cf2e89d37d7d => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:50.174418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.175071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.175346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.175611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] PATH_INFO: `/v3/projects/713caf85a4104b85af4a0b40b1b96328` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.176713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] RBAC: Authorizing `identity:get_project(project_id=713caf85a4104b85af4a0b40b1b96328)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.177324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.178142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.184206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 216/451] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/projects/713caf85a4104b85af4a0b40b1b96328 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:50.185082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.210197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.273980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ae98-0040-4b80-8d9c-f92081944615 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.280576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa519d-50d7-4b4f-bbf0-e154bcd6f478 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.292746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.307275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.307901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.308177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.308446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] PATH_INFO: `/v3/groups/201e7d3377b44df99212aad76fc04928` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.309552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] RBAC: Authorizing `identity:get_group(group_id=201e7d3377b44df99212aad76fc04928)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.311025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.312597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 236/452] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/groups/201e7d3377b44df99212aad76fc04928 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:50.313068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.314296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.314578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.314873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] PATH_INFO: `/v3/groups/31141c0f45bb43e5bf3b5f84ace4db67` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.315966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] RBAC: Authorizing `identity:get_group(group_id=31141c0f45bb43e5bf3b5f84ace4db67)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.317380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.318949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.319283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 217/453] 10.222.0.49 () {56 vars in 1180 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/groups/31141c0f45bb43e5bf3b5f84ace4db67 => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:50.324761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:50.415526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6b22b-0bc6-47be-a568-c66f8d7d5066 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.417001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:50.421297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1357dc-758f-4cb0-952e-e52bd38c8fa8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:50.449813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346b59-f240-4a2e-8066-590bf6c01da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.450400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346b59-f240-4a2e-8066-590bf6c01da0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.450690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346b59-f240-4a2e-8066-590bf6c01da0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.450970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346b59-f240-4a2e-8066-590bf6c01da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.451684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346b59-f240-4a2e-8066-590bf6c01da0 None admin] RBAC: Adding query filter params (group.id=201e7d3377b44df99212aad76fc04928, role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:50.451984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346b59-f240-4a2e-8066-590bf6c01da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.453390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346b59-f240-4a2e-8066-590bf6c01da0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.455920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7481e-04a0-498a-a29c-ba67513488fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:50.456507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7481e-04a0-498a-a29c-ba67513488fe None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:50.456785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7481e-04a0-498a-a29c-ba67513488fe None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:50.457054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7481e-04a0-498a-a29c-ba67513488fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:50.457759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7481e-04a0-498a-a29c-ba67513488fe None admin] RBAC: Adding query filter params (group.id=31141c0f45bb43e5bf3b5f84ace4db67, role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=713caf85a4104b85af4a0b40b1b96328) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:50.458063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7481e-04a0-498a-a29c-ba67513488fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:50.459179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 237/454] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/role_assignments?group.id=201e7d3377b44df99212aad76fc04928&scope.project.id=2b4f802c6aa541e18d16cf2e89d37d7d&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:50.459498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7481e-04a0-498a-a29c-ba67513488fe None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:50.465490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 218/455] 10.222.0.49 () {56 vars in 1376 bytes} [Fri Oct 28 09:35:50 2022] GET /identity/v3/role_assignments?group.id=31141c0f45bb43e5bf3b5f84ace4db67&scope.project.id=713caf85a4104b85af4a0b40b1b96328&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:53.123418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8aee-eebd-4bbd-8e9c-0a3f4ada3add None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.124460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8aee-eebd-4bbd-8e9c-0a3f4ada3add None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.124948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8aee-eebd-4bbd-8e9c-0a3f4ada3add None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.127249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 238/456] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:53.133028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d85d-a8d8-4d52-ad0d-1b3facad439f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.133850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d85d-a8d8-4d52-ad0d-1b3facad439f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.134366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898d85d-a8d8-4d52-ad0d-1b3facad439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.157684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4898d85d-a8d8-4d52-ad0d-1b3facad439f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:53.159230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4898d85d-a8d8-4d52-ad0d-1b3facad439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:53.214029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.260237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 219/457] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:53.351613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d710-ccc9-4ee6-97b9-0b8b8a48a123 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.352270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d710-ccc9-4ee6-97b9-0b8b8a48a123 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.352805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276d710-ccc9-4ee6-97b9-0b8b8a48a123 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.354707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 239/458] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:53.359664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ac84c-e98d-46bd-b466-1854b3508e7f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.360686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ac84c-e98d-46bd-b466-1854b3508e7f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.361157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ac84c-e98d-46bd-b466-1854b3508e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.386737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f98ac84c-e98d-46bd-b466-1854b3508e7f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:53.388237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f98ac84c-e98d-46bd-b466-1854b3508e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:53.465438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 220/459] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:53.615038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276d710-ccc9-4ee6-97b9-0b8b8a48a123 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.723496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b2217-7c5f-449f-a688-910ca64e26c5 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.724130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b2217-7c5f-449f-a688-910ca64e26c5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.724620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b2217-7c5f-449f-a688-910ca64e26c5 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.727439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 221/460] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:53.731543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168174-3a48-45b9-b86d-e16b9699a95d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.732031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168174-3a48-45b9-b86d-e16b9699a95d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.732493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09168174-3a48-45b9-b86d-e16b9699a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.734566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276d710-ccc9-4ee6-97b9-0b8b8a48a123 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:53.768569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-09168174-3a48-45b9-b86d-e16b9699a95d None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:53.771223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-09168174-3a48-45b9-b86d-e16b9699a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:53.797221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:53.798941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:53.799432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:53.799877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:53.811273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:53.813172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:53.829791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:53.837967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:53.838868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:53.838868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:53.838868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:53.838868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 240/461] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:53.841031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.862753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.884181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 222/462] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:53.885288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168174-3a48-45b9-b86d-e16b9699a95d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:53.960993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:53.965795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8f79a-b345-434c-ac18-f47459738d96 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.002114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.003152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.003760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.004232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.005070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:54.005580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.007184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.020742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 241/463] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:54.030791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.110345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09168174-3a48-45b9-b86d-e16b9699a95d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.123656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.136652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5773cf-5760-4de7-ab55-33314c657226 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.174198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.175222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.175683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.176132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.176986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.178844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.192049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.192703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.193139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.193611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.207241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.209146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:54.226710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:54.227712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:54.228576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:54.228576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:54.228576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:54.230267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 223/464] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:54.239650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.293287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 242/465] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:54 2022] POST /identity/v3/users => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:54.295609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.356368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.378079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ba85f-ac8e-4bbc-b4c5-78deb801c4b0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.424356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e396-b07b-4711-a1ae-17ef6e636cf5 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.428455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b43eb2-6f7c-4b9d-b2c9-5d0c1220dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.429177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b43eb2-6f7c-4b9d-b2c9-5d0c1220dd6a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.429524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b43eb2-6f7c-4b9d-b2c9-5d0c1220dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.429861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b43eb2-6f7c-4b9d-b2c9-5d0c1220dd6a None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.430583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b43eb2-6f7c-4b9d-b2c9-5d0c1220dd6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:54.430981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b43eb2-6f7c-4b9d-b2c9-5d0c1220dd6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.433172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b43eb2-6f7c-4b9d-b2c9-5d0c1220dd6a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.460030 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 224/466] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:54.461450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d2e90-a1d9-415d-bdc3-5ca5ae9342cd None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.461803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d2e90-a1d9-415d-bdc3-5ca5ae9342cd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.462139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d2e90-a1d9-415d-bdc3-5ca5ae9342cd None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.467814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 225/467] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:54.468266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fab69-60da-4c8b-a3c5-370641da8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.468824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d2e90-a1d9-415d-bdc3-5ca5ae9342cd None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.468948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fab69-60da-4c8b-a3c5-370641da8a18 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.469188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fab69-60da-4c8b-a3c5-370641da8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.469507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fab69-60da-4c8b-a3c5-370641da8a18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.472001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.484988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fab69-60da-4c8b-a3c5-370641da8a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.487178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8fab69-60da-4c8b-a3c5-370641da8a18 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-af8fab69-60da-4c8b-a3c5-370641da8a18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:54.508311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:54.509235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:54.511040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:54.511040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:54.511040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:54.511040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 243/468] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:54.517327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777899-06ee-4130-8a4b-cecbcdd43ccc None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.517327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777899-06ee-4130-8a4b-cecbcdd43ccc None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.517327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d777899-06ee-4130-8a4b-cecbcdd43ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.537580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1d777899-06ee-4130-8a4b-cecbcdd43ccc None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:54.539052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1d777899-06ee-4130-8a4b-cecbcdd43ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:54.607876 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d2e90-a1d9-415d-bdc3-5ca5ae9342cd None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.631539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 244/469] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:54.632413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777899-06ee-4130-8a4b-cecbcdd43ccc None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.665441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.666492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.667039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.667543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.668432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.670662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.759083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d777899-06ee-4130-8a4b-cecbcdd43ccc None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:54.787022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.800162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609ac9-c72e-4b6d-a0c4-6ac648591008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:54.800790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609ac9-c72e-4b6d-a0c4-6ac648591008 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.801064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609ac9-c72e-4b6d-a0c4-6ac648591008 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.801334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609ac9-c72e-4b6d-a0c4-6ac648591008 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.806407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609ac9-c72e-4b6d-a0c4-6ac648591008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:54.806407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609ac9-c72e-4b6d-a0c4-6ac648591008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:54.806407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609ac9-c72e-4b6d-a0c4-6ac648591008 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:54.806654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 226/470] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:54 2022] POST /identity/v3/users => generated 248 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:54.829652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 245/471] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:54.835624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:54.840770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:54.910596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ca7f-3588-47ea-9df8-cd4e9d872165 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.913526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ca7f-3588-47ea-9df8-cd4e9d872165 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.913526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ca7f-3588-47ea-9df8-cd4e9d872165 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.913526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 246/472] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:54.919552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e67a-3656-46e3-a2d0-7df81b9c5669 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:54.919959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e67a-3656-46e3-a2d0-7df81b9c5669 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:54.920334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3e67a-3656-46e3-a2d0-7df81b9c5669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:54.951311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fdb3e67a-3656-46e3-a2d0-7df81b9c5669 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:54.952914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fdb3e67a-3656-46e3-a2d0-7df81b9c5669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:54.991004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d0352-17e2-46cc-bd5c-29b846773fde None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:55.033838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:55.034369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:55.034641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:55.034936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:55.036329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:55.037478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:55.046844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 247/473] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:55.048342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3e67a-3656-46e3-a2d0-7df81b9c5669 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:55.149290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 227/474] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:54 2022] POST /identity/v3/users => generated 248 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:35:55.157900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3e67a-3656-46e3-a2d0-7df81b9c5669 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:55.166133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:55.203410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:55.204451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:55.204924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:55.205344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:55.217571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:55.219951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:55.239009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:55.240163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:55.241230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:55.241230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:55.241230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:55.242702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 248/475] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:55.250006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:55.357416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:55.400751 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:55.419630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c3c2-b0af-4c18-944f-c5b051269535 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:55.466115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:55.466914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:55.467202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:55.467538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:55.468483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:55.468792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:55.470769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:55.486107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 228/476] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:55.491380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:55.530814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63816-b5ae-4523-ab19-d19b8a1042fa None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:55.573222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:55.573827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:55.574104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:55.574381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:55.575101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:55.576473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:55.616743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.sql.core [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:35:55.616743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 09:35:55.616743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [parameters: {'id': '912f3bad5fc64101ac0cb3e513557994', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 09:35:55.616743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88565) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:35:55.618180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c504e7-133a-423f-8b68-3cab4943659c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:55.638285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result.read() Oct 28 09:35:55.639372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return ref.to_dict() Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:35:55.640204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application yield resource Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise self.value Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application session.commit() Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:35:55.642002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:35:55.643199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:35:55.644063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result.read() Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:35:55.644928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [parameters: {'id': '912f3bad5fc64101ac0cb3e513557994', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:55.648811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 09:35:55.655396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:55.657830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 249/477] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 09:35:55 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:55.657830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:55.672413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:55.673036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:55.676679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:55.676679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:55.676679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:55.676679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:55.703092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:55.779172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c452d41-6740-4853-9ae7-61bec3662739 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:55.788448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 229/478] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:35:55 2022] POST /identity/v3/users => generated 249 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:35:55.843760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfecac1-867d-4306-8ee1-87bb225451f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:55.844469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfecac1-867d-4306-8ee1-87bb225451f2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:55.844748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfecac1-867d-4306-8ee1-87bb225451f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:55.845014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfecac1-867d-4306-8ee1-87bb225451f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:55.860319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfecac1-867d-4306-8ee1-87bb225451f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-6bfecac1-867d-4306-8ee1-87bb225451f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:55.865733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:55.868012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:55.869937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 250/479] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:55.875000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:55.997350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24fc6-bcaf-4c11-9737-9787c9ecee1c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:56.035340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ad50f-5230-4d57-a7c4-8e5c4ec7a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:56.035997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad50f-5230-4d57-a7c4-8e5c4ec7a13d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.036277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad50f-5230-4d57-a7c4-8e5c4ec7a13d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.036542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ad50f-5230-4d57-a7c4-8e5c4ec7a13d None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.037201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad50f-5230-4d57-a7c4-8e5c4ec7a13d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:56.037496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad50f-5230-4d57-a7c4-8e5c4ec7a13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:56.038924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ad50f-5230-4d57-a7c4-8e5c4ec7a13d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:56.048062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 230/480] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:56.764241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f817a-2635-45c9-bd25-2f542f7d5063 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.764881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f817a-2635-45c9-bd25-2f542f7d5063 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.764881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f817a-2635-45c9-bd25-2f542f7d5063 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.766433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 251/481] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:56.771746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72db79-1d9d-4cc2-8b77-41ff40ed813c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:56.772218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72db79-1d9d-4cc2-8b77-41ff40ed813c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:56.772378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72db79-1d9d-4cc2-8b77-41ff40ed813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:56.791421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ce72db79-1d9d-4cc2-8b77-41ff40ed813c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:56.792709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ce72db79-1d9d-4cc2-8b77-41ff40ed813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:56.837954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:56.900458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 231/482] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:57.238607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f817a-2635-45c9-bd25-2f542f7d5063 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.334916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.364344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f817a-2635-45c9-bd25-2f542f7d5063 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.409836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.410643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.410942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.411212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.424874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:57.429676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:57.430560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:57.431390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 252/483] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:57.438850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72db79-1d9d-4cc2-8b77-41ff40ed813c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.571397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72db79-1d9d-4cc2-8b77-41ff40ed813c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.618596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1e32f-608f-4263-915c-787f84501593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.619267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1e32f-608f-4263-915c-787f84501593 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.619518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1e32f-608f-4263-915c-787f84501593 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.619784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1e32f-608f-4263-915c-787f84501593 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.620450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1e32f-608f-4263-915c-787f84501593 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:57.620751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1e32f-608f-4263-915c-787f84501593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.622132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1e32f-608f-4263-915c-787f84501593 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.634077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 232/484] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:57.639623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.818206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328fd55-c4c5-4c4e-b0d5-9451044d554d None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.818794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328fd55-c4c5-4c4e-b0d5-9451044d554d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.818794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328fd55-c4c5-4c4e-b0d5-9451044d554d None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.820300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 233/485] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:57.826750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d5da4-f9a9-434a-9bba-cd655f093996 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.826750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d5da4-f9a9-434a-9bba-cd655f093996 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.826750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d5da4-f9a9-434a-9bba-cd655f093996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.827505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f8d1b-9e19-444b-b989-a864ce1e7327 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:57.865146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-182d5da4-f9a9-434a-9bba-cd655f093996 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:57.867116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-182d5da4-f9a9-434a-9bba-cd655f093996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:57.877293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:57.877954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:57.878228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:57.878495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:57.896424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:57.896424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:57.897707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:57.914110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:57.916200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:57.917054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:57.917054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:57.917054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:57.917054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 253/486] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:57.923144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:57.932850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.029143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 234/487] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:58.068824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a0b87-ccb0-461f-ad8c-123869f39999 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.105038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.105038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.105038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.105038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.105399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:58.105674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.107088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.120146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 254/488] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:58.125065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07954-9772-41f7-98c5-248e8078b2fa None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.125385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07954-9772-41f7-98c5-248e8078b2fa None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.125658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07954-9772-41f7-98c5-248e8078b2fa None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.127328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 235/489] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:35:58.127819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.134079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248940f-1801-48e6-911e-0939d93477d1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.134360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248940f-1801-48e6-911e-0939d93477d1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.134937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248940f-1801-48e6-911e-0939d93477d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.155373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8248940f-1801-48e6-911e-0939d93477d1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:58.158640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8248940f-1801-48e6-911e-0939d93477d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:58.191861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.241726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655fda7-ba93-4834-81fb-0bb9e849ff08 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.279761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.280760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.281260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.282247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] PATH_INFO: `/v3/users/nova` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.296313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.299031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.305256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 236/490] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:58.313583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:58.314462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:35:58.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:58.317868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 255/491] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:58.325439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248940f-1801-48e6-911e-0939d93477d1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.437378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.449545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248940f-1801-48e6-911e-0939d93477d1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.462159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.498655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.499355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.499571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.499845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.500625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:58.500963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.502521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.561575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 237/492] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:58.567186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.585903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9be4-a546-43b8-a527-59286c4c9cca None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.625373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.632738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5079-80db-4eea-b3c7-0975bdad841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.633841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5079-80db-4eea-b3c7-0975bdad841b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.634324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5079-80db-4eea-b3c7-0975bdad841b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.635945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5079-80db-4eea-b3c7-0975bdad841b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.661902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5079-80db-4eea-b3c7-0975bdad841b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-334a5079-80db-4eea-b3c7-0975bdad841b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:58.671722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:58.672649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:58.673447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:58.676939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 256/493] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:35:58.681955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514ffe-e0cc-4f91-8d62-7d68a734a705 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.684830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514ffe-e0cc-4f91-8d62-7d68a734a705 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.684830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514ffe-e0cc-4f91-8d62-7d68a734a705 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.684830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 257/494] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:58.691949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514ffe-e0cc-4f91-8d62-7d68a734a705 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.748342 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad795b-f22d-40f0-a31c-7a6d973e63ad None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.784061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.784667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.784948 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.785222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.799971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.806993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514ffe-e0cc-4f91-8d62-7d68a734a705 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:58.840573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c4c22-d359-4695-a88f-492f97ada78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:58.841159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4c22-d359-4695-a88f-492f97ada78a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.841432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4c22-d359-4695-a88f-492f97ada78a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.841701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c4c22-d359-4695-a88f-492f97ada78a None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.842359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c4c22-d359-4695-a88f-492f97ada78a None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:58.842657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c4c22-d359-4695-a88f-492f97ada78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.844078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c4c22-d359-4695-a88f-492f97ada78a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.852151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:58.853292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 258/495] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:35:58.853603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:58.856908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6569d68-a8cb-433c-be60-767f5a05421b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.857197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6569d68-a8cb-433c-be60-767f5a05421b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.857467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6569d68-a8cb-433c-be60-767f5a05421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.876479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f6569d68-a8cb-433c-be60-767f5a05421b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:58.877654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f6569d68-a8cb-433c-be60-767f5a05421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:58.905939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:58.942509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 259/496] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:58.943812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b5d0-844c-4a57-925f-9f8f69fb50cb None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:58.944096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b5d0-844c-4a57-925f-9f8f69fb50cb None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:58.944365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9b5d0-844c-4a57-925f-9f8f69fb50cb None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:58.945595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 260/497] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:35:58.946328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b5d0-844c-4a57-925f-9f8f69fb50cb None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:58.962212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 238/498] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:35:58.963228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.011419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.064531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993d19-854d-4760-95c2-913a0ddd3dbb None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.064709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9b5d0-844c-4a57-925f-9f8f69fb50cb None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.100324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.100766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18beb88b-b008-4e0a-9db1-bb0dac59f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.100921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.101209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.101448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.102144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beb88b-b008-4e0a-9db1-bb0dac59f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.102576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beb88b-b008-4e0a-9db1-bb0dac59f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.103248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beb88b-b008-4e0a-9db1-bb0dac59f3a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.112523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.114066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.115059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18beb88b-b008-4e0a-9db1-bb0dac59f3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-18beb88b-b008-4e0a-9db1-bb0dac59f3a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:59.121502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.122377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:59.123238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:59.123892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 261/499] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.124971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c7b8d-fc34-4600-8545-0d37394891e1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.126587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c7b8d-fc34-4600-8545-0d37394891e1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.126881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c7b8d-fc34-4600-8545-0d37394891e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:59.135585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.136463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:59.137390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:59.137390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.137390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:59.137390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 239/500] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.137604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.148628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-689c7b8d-fc34-4600-8545-0d37394891e1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:35:59.150317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-689c7b8d-fc34-4600-8545-0d37394891e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:35:59.175236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.221759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 262/501] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:35:59.222586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c7b8d-fc34-4600-8545-0d37394891e1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.242729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.246502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54f0bf-980e-4f2a-9d54-c33278abae50 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.280786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.281409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.281715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.281983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.292122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.293590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:59.309141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.310196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:59.311058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:59.311058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.311058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:59.311058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 240/502] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.311280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.352438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c7b8d-fc34-4600-8545-0d37394891e1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.389321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.389928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.390206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.390479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.391190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:59.391493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.392853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.401262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 263/503] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:59.402134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.424012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.427444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cda16-d4af-46db-9423-fdfd6db413c3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.462366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.462995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.463274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.463544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.464181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:59.464508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.465864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.481182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 241/504] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:59.481182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.491941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.511818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17327b-89e7-4fda-be27-d67575ebe9c6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.545159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.545782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.546059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.546329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.557144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.558633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:59.572531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.573607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:59.574788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:59.574788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.574788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:59.574788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 264/505] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.574788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.584152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6e37-103d-4cc7-9e35-a8210c29ff64 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.617802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.618397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.618705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.618974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.619610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:59.619909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.621271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.632418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 242/506] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:59.633191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.643476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.674070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3852f66-718c-4478-b477-589c6f82ef08 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.704817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.709416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.710040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.710342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.710610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.722602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.724109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.734170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a654bb-54dc-4567-8603-9345be9e50cf None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:35:59.738539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.739504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:35:59.740417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:35:59.740417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:35:59.740417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:59.744253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 265/507] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.744960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.767640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.768268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.768547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.769057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.776344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.777786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:35:59.790327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.791254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 243/508] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.792153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.843653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5ffb3-7c5b-41d9-9117-8ac739e923fe None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.865849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.877138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.877777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.878860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.878860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.888463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:35:59.890742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75121d1d-c815-466a-9205-96d6a7ccb6c1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:35:59.893802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:35:59.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:35:59.895567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 266/509] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:35:59.896857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.921218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:35:59.926964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:35:59.927588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:35:59.927965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:35:59.928199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:35:59.928833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:35:59.929133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:35:59.930521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:35:59.941793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 244/510] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:35:59.942711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:35:59.997291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fbbd-b97e-4dc5-93d0-3e0104734a5d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.030600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.031246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.032052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.032334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.038934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.040373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.042221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189890da-f997-4664-83ba-9dd7b270c018 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:00.052016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:00.052853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:00.053741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 267/511] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:00.054325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.077442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.078044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.078859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.079133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.079769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:00.080074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.081461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.092358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 245/512] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:00.093157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.100580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.141776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.155226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effab50f-7aa0-4fc2-a71b-389bd7575e8d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.189221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.189821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.190100 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.190370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.190601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d55aa-ec95-40bd-82fa-5fa31417c7c3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.191115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:00.191417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.192869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.224554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.225126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.225399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.225662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.226300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:00.226594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.227978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.230634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 268/513] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:00.231462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.236073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 246/514] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:00.236859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.326716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.330260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15e8f4-645c-444c-8d24-237da5872b20 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.334988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00785b77-0814-4edb-a8e9-3353192c36cd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.347324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.363552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.364341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.364791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.365364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.366009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.367107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.367516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.367695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.367970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.368234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.368905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:00.369201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.370655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.388178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 247/515] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:00.388959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.470809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 269/516] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:36:00 2022] POST /identity/v3/users => generated 247 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:00.471674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.495816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895daf92-2855-4908-b48b-311b96fe0475 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.537502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.538141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.538415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.538708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.547418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.549026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:00.563920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:00.565085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:00.566182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 248/517] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:00.572455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.594631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad7174-08ec-4e3d-87df-952f4f95b312 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.606218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.633639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.634257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.634529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.634827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.663749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.696812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efec90-2ae0-4d9c-ad7b-19e0e5e761dd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.717332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.718846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.736826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.737668 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.738110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.738491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.748916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.751133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:00.765912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:00.767040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:00.767919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:00.767919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:00.767919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:00.767919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 249/518] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:00.768154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.829694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 270/519] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:00.830542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.862753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.879196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c04a-60f0-4def-9a18-81ef6d332bb3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.889155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:00.914916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.915521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.915803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.916075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.916793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=47f38d07f1c44175af29a9dfe93f0f37) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:00.917114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.918513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:00.933421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 250/520] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/role_assignments?user.id=47f38d07f1c44175af29a9dfe93f0f37&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:00.934260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:00.934717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa537816-46b0-45f4-835b-edec9b3e3494 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:00.976248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:00.976621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:00.976906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:00.977176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:00.977920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:00.978226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:00.979760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.003983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 271/521] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:01.004937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.083107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e5e1-7897-4ac5-8caa-4b79bd2c4788 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.129385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.129975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.130272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.130549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.131271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:01.131576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.132878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32aa1f-1a62-477b-944f-ab30a8258795 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.132998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.150400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 251/522] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:01.150400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.158136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.163648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.185582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.186578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.187315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.188577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.202179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.205091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:01.226757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:01.227732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:01.228579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:01.228579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:01.228579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:01.230743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 272/523] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:01.231718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.267605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308615-952d-41ed-926b-2bc96b77f2cc None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.305478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.306357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.306928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.307359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.370553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7b020-2e2b-4e13-8863-0bd7cfbb79a4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.381914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.383712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.395509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.419088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.419734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.420015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.420745 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.430659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.432277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:01.446090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:01.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 273/524] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:01.448266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.482630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.518086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 252/525] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:01.519222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.575702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c740aa-b52e-4f35-ae2c-d0489155c1f0 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.627855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.629172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.629897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.630318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.631418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:01.632287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.634338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.637442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09480153-8cef-4a31-bb8d-84fb714a6ec3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.647689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.653104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 274/526] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:01.654470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.673337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.673942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.674217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.678536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.678536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:01.678536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.678536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.700392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 253/527] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:01.701435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.779064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.793418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db910b1-6643-4251-b4a0-1a7ef77ae5e1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.809640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061cad4-8c61-4ed6-9a9c-5addef37271a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:01.841788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.842938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.843465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.844386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.845881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:01.846605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:01.846987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:01.847309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:01.855223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.856839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.859250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:01.861984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:01.870431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:01.871491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:01.872536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:01.873656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 254/528] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:01.874576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:01.882439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:01.883413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:01.884268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:01.884268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:01.884268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:01.887915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 275/529] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:01.889012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:01.911567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:01.986733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4196b-9bda-4551-a8ca-d41b58272e75 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.021119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.021703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.021979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.022246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.024082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efd313-c7db-4e11-85a6-94f68b457933 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.070270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.071353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.071634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.071906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.072594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:02.072895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.074376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.085594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.093068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 276/530] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:02.094488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.104570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.106126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.134408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.217033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 255/531] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:02.217841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.228130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18630dc8-3fe3-47ec-8879-c844c1b47712 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.272229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.273184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.273684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.274170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.275676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:02.276431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.278155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.295083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 277/532] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:02.296344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.331090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c6c18-608f-4919-a2a2-3ba6aee3fda5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.359696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.368174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.370227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.375725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.375725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.375725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.375725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=ff6aed7405ec4740b3c5971d24850ea6) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:02.375725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.375725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.379840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 256/533] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/role_assignments?user.id=ff6aed7405ec4740b3c5971d24850ea6&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:02.386075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.419618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9716-9b04-4120-ae40-80dd212ccd30 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.461190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.462339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.462823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.463269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.476587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.478586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:02.497984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:02.498991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:02.499843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:02.499843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:02.499843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:02.502331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 278/534] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:02.517828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.637050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14799b-1f76-4182-a03a-37c4c4dedaea None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.665523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d45a0-b08f-499a-9654-aa3d018176ff None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.677485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.684170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.685098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.690425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.690425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.694702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.697549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.706379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.707851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.708171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.708788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.709142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:02.709452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.710917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:02.713736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:02.714727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:02.715571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:02.717935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 257/535] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:02.723299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.735082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 279/536] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:02.736176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.778594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:02.832970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da43ea-6646-44db-b417-c931b50a2424 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.855686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ac63f-141a-4b01-b5b7-ccfd84dfe7a0 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:02.873424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0cf0e-542d-4f9a-8c74-39cb3a4341c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.874470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cf0e-542d-4f9a-8c74-39cb3a4341c6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.875595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cf0e-542d-4f9a-8c74-39cb3a4341c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.876065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cf0e-542d-4f9a-8c74-39cb3a4341c6 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.876948 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0cf0e-542d-4f9a-8c74-39cb3a4341c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:02.877445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0cf0e-542d-4f9a-8c74-39cb3a4341c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.879224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0cf0e-542d-4f9a-8c74-39cb3a4341c6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.893721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 258/537] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:02.893871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80f554-2dc9-4587-9d80-309da5d9c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:02.894454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f554-2dc9-4587-9d80-309da5d9c6fd None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.894759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f554-2dc9-4587-9d80-309da5d9c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.895086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80f554-2dc9-4587-9d80-309da5d9c6fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.896180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01b8c-303d-40aa-8de5-c1be15d1043c None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.897072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01b8c-303d-40aa-8de5-c1be15d1043c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.897916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff01b8c-303d-40aa-8de5-c1be15d1043c None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.899900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 259/538] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:02.900930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff01b8c-303d-40aa-8de5-c1be15d1043c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:02.906068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80f554-2dc9-4587-9d80-309da5d9c6fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:02.908026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80f554-2dc9-4587-9d80-309da5d9c6fd None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-af80f554-2dc9-4587-9d80-309da5d9c6fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:02.924685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:02.925563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:02.926388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:02.928711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 280/539] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:02.930095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ef93-62ce-4d1e-8013-15a6d10dc820 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:02.930557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ef93-62ce-4d1e-8013-15a6d10dc820 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:02.930992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50ef93-62ce-4d1e-8013-15a6d10dc820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:02.951696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-bc50ef93-62ce-4d1e-8013-15a6d10dc820 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:02.953315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-bc50ef93-62ce-4d1e-8013-15a6d10dc820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:02.978895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:03.032780 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff01b8c-303d-40aa-8de5-c1be15d1043c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:03.036227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 281/540] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:03.037613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50ef93-62ce-4d1e-8013-15a6d10dc820 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:03.044586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:03.072569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b1bbc-74bd-4017-8f73-3451bb172ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:03.073146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1bbc-74bd-4017-8f73-3451bb172ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.073473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1bbc-74bd-4017-8f73-3451bb172ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.073740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b1bbc-74bd-4017-8f73-3451bb172ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.074521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b1bbc-74bd-4017-8f73-3451bb172ee9 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=6b18f309b5cb4641997b637f8f17ac87) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:03.074886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b1bbc-74bd-4017-8f73-3451bb172ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:03.077751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b1bbc-74bd-4017-8f73-3451bb172ee9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:03.084929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 260/541] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:02 2022] GET /identity/v3/role_assignments?user.id=6b18f309b5cb4641997b637f8f17ac87&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:03.155947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50ef93-62ce-4d1e-8013-15a6d10dc820 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:03.248934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958314-d312-424a-bb38-293ac1ca2570 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.249216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958314-d312-424a-bb38-293ac1ca2570 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.249490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34958314-d312-424a-bb38-293ac1ca2570 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.251805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 261/542] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:03.257112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31078a-7c2b-4b1a-b910-1e6c9257245b None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.257393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31078a-7c2b-4b1a-b910-1e6c9257245b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.257662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31078a-7c2b-4b1a-b910-1e6c9257245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.270326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:03.271005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.271293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.271564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.272403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:03.272712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:03.274199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:03.290221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 282/543] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:03.296384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:03.303793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8b31078a-7c2b-4b1a-b910-1e6c9257245b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:03.305337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8b31078a-7c2b-4b1a-b910-1e6c9257245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:03.343122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:03.406480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 262/544] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:36:03.407540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31078a-7c2b-4b1a-b910-1e6c9257245b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:03.418275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815cbc6-4375-4c29-8845-40fbd4920c91 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:03.459873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:03.460676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.460947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.461210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.462030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=c6623b72a17b4f4493e675a344251f7b) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:03.462436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:03.464866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:03.471163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 283/545] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:03 2022] GET /identity/v3/role_assignments?user.id=c6623b72a17b4f4493e675a344251f7b&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:03.597041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31078a-7c2b-4b1a-b910-1e6c9257245b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:03.600809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:03.641991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:03.642693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.642979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.643251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.662276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:03.667180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:03.668069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:03.669252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 263/546] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:03.675126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:03.779059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:03.803018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:03.829525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97c683-2599-4021-bbf2-cc1167445379 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:03.891965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:03.892585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:03.892860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:03.893131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:03.893799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:03.894103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:03.895735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:03.914930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 284/547] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:03.917657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:03.960679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ce87d-5b5c-4557-9514-6c9d72a98813 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.023093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.023735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.024999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.025278 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.044964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:04.053530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:04.054386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:04.055609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:04.056309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 264/548] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:04.061350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.101538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e16952-9974-4c4f-bbdc-b2428ee2dd2d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.106523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.164518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.165210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.165431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.165712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.192680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.194136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.216711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129d8a-63a7-493d-b4f8-394b9e0467f5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.217212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:04.231183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:04.235201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:04.236063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:04.236063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:04.236063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:04.236063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 285/549] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:04.240645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.284828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.285438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.285769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.286247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.286960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.287250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.289065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.299333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 265/550] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:04.307682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.380183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ea87d-4b57-44a5-9d0e-7a86f8f98760 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.431427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.432010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.432290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.432558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.433201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.433500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.434895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.467762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 286/551] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:04.470938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.530601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.564882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c3e6a-51c8-48a7-9417-23b174d67149 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.575358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.619982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207be4d-c9fa-4f68-b686-f90d6e0bae24 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.647914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.648556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.648830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.649095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.669530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.671014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.689112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.689772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.690047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.690315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:04.697782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:04.698702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:04.699657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:04.699657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:04.699657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:04.699850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.700396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.703861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 266/552] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:04.708467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:04.729488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:04.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:04.731340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 287/553] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:04.737682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.878810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efc045-bb74-4503-9507-29e5523927a2 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.897049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:04.916313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9711fd2-0b04-4b5d-a47d-742f4379b3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.917048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9711fd2-0b04-4b5d-a47d-742f4379b3fb None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.917486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9711fd2-0b04-4b5d-a47d-742f4379b3fb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.917813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9711fd2-0b04-4b5d-a47d-742f4379b3fb None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.919324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9711fd2-0b04-4b5d-a47d-742f4379b3fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.919632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9711fd2-0b04-4b5d-a47d-742f4379b3fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.921080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9711fd2-0b04-4b5d-a47d-742f4379b3fb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.921187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b30a-e12e-4242-ae20-ca19cdb97478 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:04.940764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 288/554] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:04.941974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f748e-b2ac-425f-a027-e1b675fdcd43 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.942430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f748e-b2ac-425f-a027-e1b675fdcd43 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.946643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f748e-b2ac-425f-a027-e1b675fdcd43 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.948927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 289/555] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:04.949723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f748e-b2ac-425f-a027-e1b675fdcd43 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:04.963334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5796b-b5bb-4dc8-8ea7-34e0585b71ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:04.963943 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5796b-b5bb-4dc8-8ea7-34e0585b71ea None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.964221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5796b-b5bb-4dc8-8ea7-34e0585b71ea None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.964490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5796b-b5bb-4dc8-8ea7-34e0585b71ea None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.965127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5796b-b5bb-4dc8-8ea7-34e0585b71ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:04.965425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5796b-b5bb-4dc8-8ea7-34e0585b71ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:04.967014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5796b-b5bb-4dc8-8ea7-34e0585b71ea None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:04.980266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 267/556] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:04.981674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665ba2-0098-4513-8fa9-5811fdbc007a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:04.981964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665ba2-0098-4513-8fa9-5811fdbc007a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:04.982327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665ba2-0098-4513-8fa9-5811fdbc007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:04.995022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.008119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-c0665ba2-0098-4513-8fa9-5811fdbc007a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:05.009921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c0665ba2-0098-4513-8fa9-5811fdbc007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:05.064782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f748e-b2ac-425f-a027-e1b675fdcd43 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.092633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 268/557] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:05.094109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0665ba2-0098-4513-8fa9-5811fdbc007a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.158536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.159198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.159495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.159769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.213903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0665ba2-0098-4513-8fa9-5811fdbc007a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.243060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.251337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.252120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.252463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.252740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] PATH_INFO: `/v3/users/nova` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.260835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.266088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:05.276239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:05.277470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:05.278434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 269/558] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:05.287208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.308826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.396870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691337d8-7006-429e-b7d5-f80bcf094bae None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.400360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.401926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.436499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.437124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.437456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.437731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.438481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:05.438826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.440315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.463061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 270/559] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:05.471819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.523062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.547077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 290/560] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:05.558820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.584865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1aaab-8264-477a-bff0-1e7602240bea None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.618484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.619133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.619411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.619676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.630973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.632413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.633015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:05.647524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:05.648466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:05.649622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:05.649622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:05.649622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:05.649622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 271/561] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:05.650415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.661931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca700126-b38b-4d41-b921-b56b489ec185 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.702552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d813cd-9f08-4d41-a6ec-d9ca55ad2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.704048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d813cd-9f08-4d41-a6ec-d9ca55ad2916 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.704380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d813cd-9f08-4d41-a6ec-d9ca55ad2916 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.704661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d813cd-9f08-4d41-a6ec-d9ca55ad2916 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.714970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d813cd-9f08-4d41-a6ec-d9ca55ad2916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-48d813cd-9f08-4d41-a6ec-d9ca55ad2916 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:05.719822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:05.720831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:05.721647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 291/562] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:05.722885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7df63-fb18-4f2a-b5fe-7679c20d4755 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.722885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7df63-fb18-4f2a-b5fe-7679c20d4755 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.722885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7df63-fb18-4f2a-b5fe-7679c20d4755 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.723944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 292/563] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:05.727603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7df63-fb18-4f2a-b5fe-7679c20d4755 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.766162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.771090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53039-3110-4877-9f36-f086b14592fa None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.804033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.805179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.805961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.806233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.817012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.818990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.834050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7df63-fb18-4f2a-b5fe-7679c20d4755 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:05.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:05.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:05.844678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:05.844678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:05.844678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:05.844678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 272/564] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:05.844678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.872593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aba28-eea9-4aa8-9892-6d8c5670349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.873525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aba28-eea9-4aa8-9892-6d8c5670349a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.873804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aba28-eea9-4aa8-9892-6d8c5670349a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.874074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aba28-eea9-4aa8-9892-6d8c5670349a None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.875258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269aba28-eea9-4aa8-9892-6d8c5670349a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:05.875586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269aba28-eea9-4aa8-9892-6d8c5670349a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.877021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269aba28-eea9-4aa8-9892-6d8c5670349a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:05.880414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:05.890512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 293/565] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:05.893593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ee0f0-0385-4bf0-a4ab-99748715c46a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.893593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ee0f0-0385-4bf0-a4ab-99748715c46a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.893593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ee0f0-0385-4bf0-a4ab-99748715c46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.912435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-067ee0f0-0385-4bf0-a4ab-99748715c46a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:05.914062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-067ee0f0-0385-4bf0-a4ab-99748715c46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:05.954906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d27c52-c8c9-42fd-bc8b-318d141db9bf None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:05.981874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 294/566] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:05.987892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ee0f0-0385-4bf0-a4ab-99748715c46a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:05.991479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:05.992090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:05.992369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:05.992637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:05.993299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:05.993597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:05.994979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.007885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 273/567] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:06.007885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.021906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.099551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ee0f0-0385-4bf0-a4ab-99748715c46a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.117121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee1454-6e3e-4193-bcc3-404e1242f61e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.127982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.137837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4dbb7b-14b6-4b68-aa22-9ba32521c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.138440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dbb7b-14b6-4b68-aa22-9ba32521c932 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.138743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dbb7b-14b6-4b68-aa22-9ba32521c932 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.139011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dbb7b-14b6-4b68-aa22-9ba32521c932 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.139697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dbb7b-14b6-4b68-aa22-9ba32521c932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:06.139992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dbb7b-14b6-4b68-aa22-9ba32521c932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.141582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4dbb7b-14b6-4b68-aa22-9ba32521c932 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.157205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 295/568] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:06.157364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.157364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.157364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.157609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4ed3d-d10b-488a-97bc-fe771b788cd4 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.157717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.157803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4ed3d-d10b-488a-97bc-fe771b788cd4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.157803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4ed3d-d10b-488a-97bc-fe771b788cd4 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.157803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 296/569] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:06.157803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4ed3d-d10b-488a-97bc-fe771b788cd4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.165625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.167926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:06.180873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:06.181760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:06.182640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 274/570] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:06.183148 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.256765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.274623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4ed3d-d10b-488a-97bc-fe771b788cd4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.285924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c8859-c011-46bc-b64a-722ebf038562 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.309237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b2d4-8e2d-4594-a195-38b66780170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.309853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b2d4-8e2d-4594-a195-38b66780170d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.310128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b2d4-8e2d-4594-a195-38b66780170d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.310396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b2d4-8e2d-4594-a195-38b66780170d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.318586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.319220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.319502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.319769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.320603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712b2d4-8e2d-4594-a195-38b66780170d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.322042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712b2d4-8e2d-4594-a195-38b66780170d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.326189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.327624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-9712b2d4-8e2d-4594-a195-38b66780170d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:06.335549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:06.336500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:06.337397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:06.337397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:06.337397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:06.337397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 297/571] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:06.337866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1c37-ca39-4cf1-8237-9aed9b98ea16 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.338067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1c37-ca39-4cf1-8237-9aed9b98ea16 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.338339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b1c37-ca39-4cf1-8237-9aed9b98ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:06.338510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:06.339409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:06.340272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 275/572] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:06.340737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.360166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c30b1c37-ca39-4cf1-8237-9aed9b98ea16 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:06.361498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c30b1c37-ca39-4cf1-8237-9aed9b98ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:06.390441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.428057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 298/573] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:06.428877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b1c37-ca39-4cf1-8237-9aed9b98ea16 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.443924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8e369-b336-4317-ad0c-7f0afb243109 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.474533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.480011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.480613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.480889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.481158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.481891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:06.482197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.483645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.500325 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 276/574] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:06.500325 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.547227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b1c37-ca39-4cf1-8237-9aed9b98ea16 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.581412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.582315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.582793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.583374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.595018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:06.598306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c0486-cfe3-464e-9f59-cdc043cd410b None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:06.600109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:06.600980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:06.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 299/575] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:06.602494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.635693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.636293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.636565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.636833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.637506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:06.637808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.639271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.642391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.656959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 277/576] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:06.656959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.711332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.723621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53d581-14eb-45cc-b5ff-8529c5045b44 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.756243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3287d90-f53a-48d8-bd87-b0028ca5bc63 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.756551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.757143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.757416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.757679 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.758303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:06.758595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.759976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.771207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 300/577] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:06.771983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.790197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.790888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.791166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.791440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/47f38d07f1c44175af29a9dfe93f0f37/roles/e8a675fd394b45de927f3b1058683873` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.805476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=47f38d07f1c44175af29a9dfe93f0f37, role_id=e8a675fd394b45de927f3b1058683873)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.806901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.857825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:06.869051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3c0b-6528-4328-a300-87e03c93ac27 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:06.883352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 278/578] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:06 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/47f38d07f1c44175af29a9dfe93f0f37/roles/e8a675fd394b45de927f3b1058683873 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:06.884267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:06.903078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:06.903696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:06.903968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:06.904239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:06.904914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:06.905216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:06.907215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:06.917214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 301/579] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:06.918088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.002587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b74bc-7492-4ded-a017-3adb55f58deb None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.004246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.042064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.042712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.042988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.043260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.043358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0681ef-46bc-4fa3-b742-45811a0f57db None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.044060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=23992d468c5c427f9cac898359ee569a) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:07.044370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.046561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.051510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 279/580] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/role_assignments?user.id=23992d468c5c427f9cac898359ee569a&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:07.052400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.090028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.090594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.090897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.091165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.106168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:07.112521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:07.114655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:07.115538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:07.116796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 302/581] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:07.117964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.133219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.229647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c2cb-4f55-40a1-b209-11b9dcfaa9ad None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.243825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7102c3-2f24-4fcd-9a0a-6d894a489faa None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.269939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.270570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.270871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.271139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.284080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.285538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.297749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.299090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.299572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.300083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:07.301645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:07.302546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 280/582] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:07.304158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.318854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.321188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.335556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:07.348310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:07.350170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:07.351136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:07.351136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:07.351136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:07.351136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 303/583] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:07.351136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.420312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.434899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66235be0-e6fd-4314-9d18-f116c0d1ffb7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.464687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ec9c4-f755-40ec-838a-db3e0fa1715d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.480753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.481358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.481633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.481905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.482560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:07.483082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.485520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.496664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 281/584] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:07.497858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.509538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.510477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.511015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.511586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.512539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:07.513095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.514867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.539401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 304/585] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:07.540564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.632204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceff63b-8039-46b8-a33a-49eb84735d39 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.651082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.653416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b24d-11cd-41c5-b7fb-705b6c4c330b None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.675692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.679422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.679422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.679609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.679688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.679688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:07.679688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.680577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.696118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 282/586] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:07.696815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.700406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.701279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.702156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.702636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.714911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.716924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:07.732692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:07.733676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:07.735121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:07.735121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:07.735121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:07.737238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 305/587] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:07.738530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.807783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6587e-9460-43af-9bf2-32e25d6d16ef None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.843277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.844438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.844761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.845268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.848564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bef377-bf2c-4827-b3a3-4f0718d0fe44 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:07.855529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.857103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.867880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:07.874850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:07.876109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:07.877143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:07.877143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:07.877143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:07.879071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 283/588] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:07.880038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.893141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:07.894002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:07.894425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:07.894955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:07.906968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:07.908906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:07.922539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:07.923511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:07.924527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:07.926780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 306/589] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:07.927849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:07.963803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:07.998733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924cad2-0b2a-4194-9c7e-fd086f920169 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.034082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.034861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.035227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.035575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.036273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.036639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.038184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.041715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679893e-f56d-4e80-9d1f-47816bb9dafc None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.051212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 284/590] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.052270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.079450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.080513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.080969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.081463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.082379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.082910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.084594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.098328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 307/591] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.099801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.113467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.158071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d0172-bd07-4fda-a2af-6e88e022e826 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.193232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.193781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.194058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.194324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.195220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.195465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.196911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.203265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.212566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666a998-d284-4cf9-a22d-a5404da875d9 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.221703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 285/592] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.228370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.250597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.251387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.251891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.252259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.260368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.262041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:08.275901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:08.277043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:36:08.278167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:08.280164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 308/593] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:08.281584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.332884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31602658-42fc-4d15-a3a7-569af0125d10 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.352865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.371674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.372685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.373136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.373683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.381572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.383319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.391427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f454c-f4c6-4a99-9ecb-35c662e8d12c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:08.396555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:08.397392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:08.398255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:08.400590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 286/594] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:08.401670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.428603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.429233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.429503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.429779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.441828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.443403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:08.458663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:08.459608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:08.460481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:08.460481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:08.460481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:08.464791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 309/595] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:08.465743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.469765 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.508678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02460efb-880a-4de3-b272-b81596d588d1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.545575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.546601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.547600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.548059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.549248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.549758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.551513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.570288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 287/596] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.571552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.575905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc18ac-4d9c-45e6-8060-a7837ac7983a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.607853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.613632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.614423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.614866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.615279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.622968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.622968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.622968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.633406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 310/597] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.634659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.679321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecde0-af45-4119-826a-a68afa093d01 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.712533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.716577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.717141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.717413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.717729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.719041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:08.719708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.720886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.737795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 288/598] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:08.737795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.760734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf803a3-733a-4888-abb6-b1df7c07207a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.799071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.800008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.800489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.800944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.812549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.814483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:08.830637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:08.831627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:08.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:08.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:08.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:08.834701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 311/599] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:08.835815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.839793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.846859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481260e-e08a-4220-ae89-de56e84f1997 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.884081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.885254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.886033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.886515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/ff6aed7405ec4740b3c5971d24850ea6/roles/e8a675fd394b45de927f3b1058683873` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.903326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=ff6aed7405ec4740b3c5971d24850ea6, role_id=e8a675fd394b45de927f3b1058683873)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.905189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:08.944201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb048a-652a-466a-8c48-7202e187a09a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:08.961297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:08.979491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:08.980116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:08.980600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:08.980913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:08.983152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 289/600] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:08 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/ff6aed7405ec4740b3c5971d24850ea6/roles/e8a675fd394b45de927f3b1058683873 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:08.984509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:08.988441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:08.991112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:09.018747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:09.019715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:09.021091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:09.026150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 312/601] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:09.031779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.199098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ecc0-dc9b-48ad-9ec9-a9d8fc928983 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.214769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16311d3-2cd8-4f4b-b9c0-0321f4224f17 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.239339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354925e8-b1ff-4ada-b7df-8dcaaa418f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.239944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354925e8-b1ff-4ada-b7df-8dcaaa418f77 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.240222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354925e8-b1ff-4ada-b7df-8dcaaa418f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.240493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354925e8-b1ff-4ada-b7df-8dcaaa418f77 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.241141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354925e8-b1ff-4ada-b7df-8dcaaa418f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:09.241442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354925e8-b1ff-4ada-b7df-8dcaaa418f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:09.244466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354925e8-b1ff-4ada-b7df-8dcaaa418f77 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.256139 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.256826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.257168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.257497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.257812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 290/602] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:09.258305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:09.258692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:09.259081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62db77-d2d7-416d-9bff-313f1407fe9c None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.259495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62db77-d2d7-416d-9bff-313f1407fe9c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.259778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62db77-d2d7-416d-9bff-313f1407fe9c None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.260373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.261212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 291/603] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:09.266835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df8f0-049a-4608-ae63-4ac0a84046e2 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.267112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df8f0-049a-4608-ae63-4ac0a84046e2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.267383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df8f0-049a-4608-ae63-4ac0a84046e2 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.269169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 292/604] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:09.270169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8bc00-3041-4f95-8bbe-e1a51a7c3c07 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.270945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8bc00-3041-4f95-8bbe-e1a51a7c3c07 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.271230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8bc00-3041-4f95-8bbe-e1a51a7c3c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.273908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 313/605] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:09.275091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.291051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:09.292684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-c9d8bc00-3041-4f95-8bbe-e1a51a7c3c07 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:09.294043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c9d8bc00-3041-4f95-8bbe-e1a51a7c3c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:09.311683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:09.360836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 293/606] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:09.362089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301bb3-3abd-4762-9a40-dae0af07ed60 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.362369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301bb3-3abd-4762-9a40-dae0af07ed60 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.362634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301bb3-3abd-4762-9a40-dae0af07ed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.381845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-05301bb3-3abd-4762-9a40-dae0af07ed60 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:09.383031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-05301bb3-3abd-4762-9a40-dae0af07ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:09.383913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2049b-8ad0-41a1-b369-ec14520f2bd1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.421821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.423286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.423802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.424269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.431656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:09.433340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:09.446785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:09.447684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:09.448554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:09.450617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 314/607] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:09.451675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.470817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 294/608] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:09.472034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301bb3-3abd-4762-9a40-dae0af07ed60 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.590239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:09.621355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:09.628340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65164ac-dffa-4d5f-b26a-32d3b43873e1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.652457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301bb3-3abd-4762-9a40-dae0af07ed60 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.681935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.682277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.682480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.682777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/6b18f309b5cb4641997b637f8f17ac87/roles/e8a675fd394b45de927f3b1058683873` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.697667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.698409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.698840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.699114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.699812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:09.700113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:09.700566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=6b18f309b5cb4641997b637f8f17ac87, role_id=e8a675fd394b45de927f3b1058683873)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:09.701593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.702266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:09.714376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 295/609] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:09.719975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.775785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 315/610] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:09 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/6b18f309b5cb4641997b637f8f17ac87/roles/e8a675fd394b45de927f3b1058683873 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:09.776580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.840233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008763c-d873-4850-a1aa-a854280b98a5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.871386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:09.882005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.882566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.882924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.883247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.895859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:09.902933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:09.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:09.905104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:09.911673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 296/611] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:09.912856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:09.932018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c25c76-d986-4362-a6ed-46ac69bca7ca None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:09.978619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:09.979241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:09.979521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:09.979793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/c6623b72a17b4f4493e675a344251f7b/roles/e8a675fd394b45de927f3b1058683873` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:09.999112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=c6623b72a17b4f4493e675a344251f7b, role_id=e8a675fd394b45de927f3b1058683873)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.001203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:10.004929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:10.039192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ce588-c6f8-4b76-94eb-bccd29539c53 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.075022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.075652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.075948 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.076179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.087101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 316/612] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:09 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/c6623b72a17b4f4493e675a344251f7b/roles/e8a675fd394b45de927f3b1058683873 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:10.088613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.099556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:10.105032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:10.105942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:10.111193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 297/613] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:10.113079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.229079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:10.277660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e274f4-5413-41e9-87d5-b941d295f3c7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.336117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f18250-e1e6-4cd9-b687-448aa1bd92a8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.339955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.340566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.340838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.341099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.341752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:10.342046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.343461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:10.352624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 317/614] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:10.359617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.383751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.384451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.384729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.384997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.385653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:10.385954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.387654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:10.404753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 298/615] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:10.412814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.441130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:10.526232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f4799-ebab-41c8-8418-431acc2d1d81 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.590277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.590935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.591209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.591476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.600534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac99f0-7f56-4acc-a59c-c152637ef037 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.615750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.617184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:10.619393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:10.638905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:10.639889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:10.640806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:10.640806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:10.640806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:10.642952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 318/616] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:10.648298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.651874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.653246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.653246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.653246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.675456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.676910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:10.711725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:10.712702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:10.714310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:10.714310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:10.714310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:10.714310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 299/617] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:10.723593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.764725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896f7d4-fb82-4eec-a557-aa085d0f4cc3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.783114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:10.804752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.805719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.806359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.806884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.807866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:10.808380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.810098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:10.825608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 319/618] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:10.831809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:10.954064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf42b2-c4a0-4ba9-8584-43e959d0b3f7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:10.993224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:10.993824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:10.994109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:10.994358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:10.995225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:10.995520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:10.997711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.005985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6784f-87c5-467a-97de-f164e9f9ad05 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.022893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 300/619] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:11.028575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.065907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.072224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.086944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.086944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.086944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.086944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.087428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:11.110475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:11.111541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:11.112508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:11.115699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 320/620] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:11.122257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.165040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.237707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79289f9-9e44-4147-929b-9f837c339bd2 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.252344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acfdd7-8341-4ba0-ac29-5c09d32b9897 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.304794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58af1f-f56d-41bf-bcc3-93f9ac116a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.305782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58af1f-f56d-41bf-bcc3-93f9ac116a05 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.306262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58af1f-f56d-41bf-bcc3-93f9ac116a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.306751 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58af1f-f56d-41bf-bcc3-93f9ac116a05 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.307701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58af1f-f56d-41bf-bcc3-93f9ac116a05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:11.308213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58af1f-f56d-41bf-bcc3-93f9ac116a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.309822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58af1f-f56d-41bf-bcc3-93f9ac116a05 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.334732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340b00-f26f-481a-8169-bc1bc47b2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.335685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340b00-f26f-481a-8169-bc1bc47b2379 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.336200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340b00-f26f-481a-8169-bc1bc47b2379 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.336670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340b00-f26f-481a-8169-bc1bc47b2379 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.344262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 321/621] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:11.350728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340b00-f26f-481a-8169-bc1bc47b2379 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.352218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340b00-f26f-481a-8169-bc1bc47b2379 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.353102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11966-6bff-4261-96d2-53741e77d320 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.353451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11966-6bff-4261-96d2-53741e77d320 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.353795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d11966-6bff-4261-96d2-53741e77d320 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.359428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 322/622] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:11.359428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11966-6bff-4261-96d2-53741e77d320 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c7340b00-f26f-481a-8169-bc1bc47b2379 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:11.373033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:11.374010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:11.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 301/623] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:11.375656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8196ab9-bf04-4aa2-8f12-d71b584f114a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.376240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8196ab9-bf04-4aa2-8f12-d71b584f114a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.376240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8196ab9-bf04-4aa2-8f12-d71b584f114a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.404223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a8196ab9-bf04-4aa2-8f12-d71b584f114a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:11.405403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a8196ab9-bf04-4aa2-8f12-d71b584f114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:11.475071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.489989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d11966-6bff-4261-96d2-53741e77d320 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.498700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 302/624] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:11.498700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8196ab9-bf04-4aa2-8f12-d71b584f114a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.513509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.564222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.564873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.565153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.565419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.664094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8196ab9-bf04-4aa2-8f12-d71b584f114a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.696016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.704315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.738245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.738875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.739152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.739418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.740206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:11.740512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.742890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.780821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 303/625] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:11.786143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.859042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.871991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 323/626] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:11.872899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:11.875114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:11.910843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984619c4-10f7-4108-8105-1cfcace6284a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.947661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:11.948628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:11.949133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:11.949600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:11.960930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:11.962694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:11.977273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:11.978238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:11.979155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:11.979155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:11.979155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:11.981207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 304/627] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:11.981316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49ab13-3f9d-44ea-838b-56a6036bf977 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:11.982417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.019672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.020308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.021260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.021260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.031720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:12.037444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:12.038374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:12.039685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:12.043452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 324/628] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:12.044396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.098285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552f7a8-8ddd-4b1b-b59f-66a6dd0ea20a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.107103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.121268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.137519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.138531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.139044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.139545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.151398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.153233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.163807 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039396d-3599-4335-927a-a9a9719cb1f8 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:12.171082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:12.172562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:12.173456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:12.173456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:12.173456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:12.175600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 305/629] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:12.176614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.202275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.202879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.203161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.203457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.204100 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.204406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.205752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.222529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 325/630] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.222529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.283652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242656e-6394-4005-91cc-fd9b329bae8e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.318124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dde9b2-9887-4cfe-bb3c-b1af556b301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.318994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde9b2-9887-4cfe-bb3c-b1af556b301f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.319275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde9b2-9887-4cfe-bb3c-b1af556b301f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.319602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde9b2-9887-4cfe-bb3c-b1af556b301f None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.320264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dde9b2-9887-4cfe-bb3c-b1af556b301f None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.320597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dde9b2-9887-4cfe-bb3c-b1af556b301f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.321933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dde9b2-9887-4cfe-bb3c-b1af556b301f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.329250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158fdd7-0bb6-456b-98d4-680ec88b667d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.329845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 306/631] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.331007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7249b8-1cce-4178-930e-5e7627cf61c0 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.331282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7249b8-1cce-4178-930e-5e7627cf61c0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.331549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7249b8-1cce-4178-930e-5e7627cf61c0 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.336829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 307/632] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:12.337482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7249b8-1cce-4178-930e-5e7627cf61c0 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.344629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.372785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.373386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.373739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.374018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.374694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.375130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.375742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.377533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.389748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 326/633] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.390660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.451544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7249b8-1cce-4178-930e-5e7627cf61c0 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.488344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99947e9f-1a83-4201-9ce8-1015852c38df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.488884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947e9f-1a83-4201-9ce8-1015852c38df None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.489161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947e9f-1a83-4201-9ce8-1015852c38df None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.489428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99947e9f-1a83-4201-9ce8-1015852c38df None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.496181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99947e9f-1a83-4201-9ce8-1015852c38df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.497609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99947e9f-1a83-4201-9ce8-1015852c38df None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.499168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2dcd3-fed4-4d36-8f40-98807f38b4c3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-99947e9f-1a83-4201-9ce8-1015852c38df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:12.509231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:12.510308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:12.511390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 308/634] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:12.511893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119397-e876-4de3-857e-375edcf84436 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.512036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119397-e876-4de3-857e-375edcf84436 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.512613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119397-e876-4de3-857e-375edcf84436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.530176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4c119397-e876-4de3-857e-375edcf84436 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:12.531896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4c119397-e876-4de3-857e-375edcf84436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:12.540680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.541308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.541603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.541868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.553412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.554872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:12.569657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:12.570774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:12.571659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:12.571659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:12.571659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:12.571659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 327/635] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:12.571659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.594171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.597981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 309/636] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:12.598846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119397-e876-4de3-857e-375edcf84436 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.623419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.696763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3dd14-f387-4c65-9f23-c0a85feeb5e5 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.716181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119397-e876-4de3-857e-375edcf84436 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.735696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fac996-9b21-478e-af9b-73663debcf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.736726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fac996-9b21-478e-af9b-73663debcf6d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.737008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fac996-9b21-478e-af9b-73663debcf6d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.737272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fac996-9b21-478e-af9b-73663debcf6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.744928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fac996-9b21-478e-af9b-73663debcf6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.746314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fac996-9b21-478e-af9b-73663debcf6d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.750279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.750903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.751180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.751444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.752117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.752407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.753806 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e2fac996-9b21-478e-af9b-73663debcf6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:12.758012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:12.758994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 328/637] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f7baa-fe3a-4b11-b82e-39fc7575fbf3 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.765539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f7baa-fe3a-4b11-b82e-39fc7575fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.766485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f7baa-fe3a-4b11-b82e-39fc7575fbf3 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.766564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 310/638] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.771594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.771928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 329/639] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:12.771928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f7baa-fe3a-4b11-b82e-39fc7575fbf3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.856907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.860413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:12.873296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f56fb-07aa-432f-a365-2f59076abc65 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.880945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f7baa-fe3a-4b11-b82e-39fc7575fbf3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:12.909555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080a10d-e396-4bf8-a273-ff1c6908dfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.910245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080a10d-e396-4bf8-a273-ff1c6908dfcc None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.910587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080a10d-e396-4bf8-a273-ff1c6908dfcc None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.910941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080a10d-e396-4bf8-a273-ff1c6908dfcc None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.911574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080a10d-e396-4bf8-a273-ff1c6908dfcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.911867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080a10d-e396-4bf8-a273-ff1c6908dfcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.913228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080a10d-e396-4bf8-a273-ff1c6908dfcc None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.915997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:12.916678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.917198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.917695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.918418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:12.919136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:12.920541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:12.924216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 311/640] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.925347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8036d1-3c7c-484f-ad5a-b685c0a4e016 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:12.925624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8036d1-3c7c-484f-ad5a-b685c0a4e016 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:12.925890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8036d1-3c7c-484f-ad5a-b685c0a4e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:12.933864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 330/641] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:12.934563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:12.942774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-bb8036d1-3c7c-484f-ad5a-b685c0a4e016 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:12.943944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bb8036d1-3c7c-484f-ad5a-b685c0a4e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:13.008182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 312/642] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:13.008925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8036d1-3c7c-484f-ad5a-b685c0a4e016 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.043966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696895c-2f13-47f5-b692-5885a94b47e6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.078350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.079015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.079286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.079548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/23992d468c5c427f9cac898359ee569a/roles/e8a675fd394b45de927f3b1058683873` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.085953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.090615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.094393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=23992d468c5c427f9cac898359ee569a, role_id=e8a675fd394b45de927f3b1058683873)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.100127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.110496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8036d1-3c7c-484f-ad5a-b685c0a4e016 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.142553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.143212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.143486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.143749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.153471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:13.158223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:13.159376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 313/643] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:13.160584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.247985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 331/644] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:12 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/23992d468c5c427f9cac898359ee569a/roles/e8a675fd394b45de927f3b1058683873 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:13.248964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.273009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bc800-0261-4c8a-bf5f-10f1f88c482d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.311089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.312368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.312707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.313038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] PATH_INFO: `/v3/users/glance` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.315438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.321890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.323392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:13.336291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:13.337354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 314/645] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:13.339225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.372970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b27e1-a827-4730-99f5-1832df16c646 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.418126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.419213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.419716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.420184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.422247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=47f38d07f1c44175af29a9dfe93f0f37) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:13.422797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.425347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.432726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 332/646] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/role_assignments?user.id=47f38d07f1c44175af29a9dfe93f0f37&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:13.433869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.459583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882b4c3-be72-4641-94e6-39ac74a4514a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.505268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.506628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.507145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.507597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.508968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:13.509733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.511048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.511662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.524715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 315/647] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:13.526888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.564557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b969c6e-c5b3-4958-9783-d5a5e96cfb02 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.602566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.608105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.609676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.610187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.610697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.623861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:13.629700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:13.630637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:13.631520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:13.638167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 333/648] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:13.638167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.652066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3c522-f5f6-42ab-8988-836169279559 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.702598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.703158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.704010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.704010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.704402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:13.704698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.706117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.728066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 316/649] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:13.729441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.778773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a8783-a0d0-4b60-a2e5-f8719954ab20 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.786219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.809594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.810229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.810507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.814627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.827855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.829552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.848206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f4d3-7c4e-45de-8c9f-d1740b9d91d6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:13.848462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:13.849632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:13.850926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:13.850926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:13.850926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:13.850926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 334/650] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:13.856399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.866268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:13.886625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:13.887472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:13.887843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:13.888211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:13.888965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:13.889340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:13.890858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:13.899556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 317/651] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:13.900508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:13.975057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef0c82-08db-4121-99af-d5cb24ccb93f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.012801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.013509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.013860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.014204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.019044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcd6e2-b2c8-4703-8831-fdf982ad0719 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.052273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.061282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.062016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.062360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.062716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.063738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:14.064107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.065815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.083623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 318/652] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:14.084507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.095918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.098099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.176225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.213002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750132-4951-4a2a-b084-2a134b4acfc1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.219149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 335/653] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:14.220847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.261049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.261684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.262113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.262394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.276129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.278320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:14.298340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:14.299370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:14.300349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:14.300349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:14.300349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:14.300349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 319/654] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:14.301003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.327119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.339133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d736d50-d18e-4763-b0ca-50854a191b21 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.375349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.376323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.376890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.377480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.385034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.386973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:14.400398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:14.401409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:14.402356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:14.410289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 336/655] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:14.410853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.412600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.421243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2d6d2-0c78-4a72-bf7f-02bada5b8ab0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.464956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.465695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.465919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.466196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.479800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.482006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:14.506418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:14.507449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:14.508322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:14.508322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:14.508322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:14.510744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 320/656] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:14.511762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.529011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ce77-49ab-4db5-8958-38dc8ca84cba None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.563226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.567338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.568171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.568697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.569164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.570126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:14.570796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.572344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.585997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 337/657] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:14.587764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.627026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a47541-a797-4393-be6a-17002d9f282d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.668280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.668885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.669163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.669428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.670144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:14.670445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.672451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.682474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.695126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 321/658] 10.222.0.49 () {56 vars in 1137 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:14.702707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.723022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582f60e-3f3b-436e-91d1-514c803b8c73 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.766493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.767582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.768067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.768554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.769380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:14.769882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.771456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.785519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 338/659] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:14.786645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.803530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcf4d9-4b36-4e4a-ac4f-a670a80c179d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.838990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.839548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.839825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.840094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.841692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.847908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:14.849360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:14.862355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:14.863355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 322/660] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:14.864270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:14.916744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077924a-a0b0-4cee-b245-8c38a3f86df1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:14.934464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:14.958948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:14.959808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:14.960341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:14.960799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:14.979083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269a1c-f9e1-49b7-a851-9d0953730d1a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.014071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.015403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.015779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.016147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.023524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.025425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:15.037797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:15.038945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:15.040092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:15.046286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 323/661] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:15.047312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.048250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.049824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.106852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.154884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368888fa-6e82-4847-8a7e-290469675d4d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.171915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 339/662] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:15.173064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.178492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.200313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.201235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.201854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.202855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.204378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:15.204836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.207259 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.229562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 324/663] 10.222.0.49 () {56 vars in 1139 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:15.230771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.292397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7be53-35f8-48d1-a939-3ac1d5594529 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.334854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.335228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c91bde-36da-4365-90cc-20c3b1d35adb None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.335886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.336314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.336720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.337816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:15.339141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.340702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.355612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 340/664] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:15.356734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.366958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.377948 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.378821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.382050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.382050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.391605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.393245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:15.410161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:15.411362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:15.412453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:15.412453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:15.412453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:15.418284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 325/665] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:15.419288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.453317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.483338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ab68-704a-4abc-a85d-b5beed74e18c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.525649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70faa214-e30d-4b7b-937a-7b32d9e436f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.526504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faa214-e30d-4b7b-937a-7b32d9e436f1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.526949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faa214-e30d-4b7b-937a-7b32d9e436f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.527637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70faa214-e30d-4b7b-937a-7b32d9e436f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.537683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8821-e130-4d90-b633-627df37a9391 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.574844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.575452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.575718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.575983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.576718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=ff6aed7405ec4740b3c5971d24850ea6) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:15.577019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.579019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.584851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 326/666] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/role_assignments?user.id=ff6aed7405ec4740b3c5971d24850ea6&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:15.586833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.611558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faa214-e30d-4b7b-937a-7b32d9e436f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.613837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70faa214-e30d-4b7b-937a-7b32d9e436f1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.624687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.722156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.736831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96b5e-c126-4b45-92e3-be71b94aef52 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.744770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 341/667] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:15.746185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128cdd7-c6e9-4e19-92bc-5526f9077028 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.746542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128cdd7-c6e9-4e19-92bc-5526f9077028 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.746907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128cdd7-c6e9-4e19-92bc-5526f9077028 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.748561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 342/668] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:15.750529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128cdd7-c6e9-4e19-92bc-5526f9077028 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.787544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d02a7d-8804-44de-a733-22a184ddade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.788463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02a7d-8804-44de-a733-22a184ddade2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.788916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02a7d-8804-44de-a733-22a184ddade2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.789375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d02a7d-8804-44de-a733-22a184ddade2 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.790399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d02a7d-8804-44de-a733-22a184ddade2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:15.790977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d02a7d-8804-44de-a733-22a184ddade2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.792598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d02a7d-8804-44de-a733-22a184ddade2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.805229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 327/669] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:15.806324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76e01-c853-4ddb-9fc9-18aa2ee73c69 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.806601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76e01-c853-4ddb-9fc9-18aa2ee73c69 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.807773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76e01-c853-4ddb-9fc9-18aa2ee73c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.827697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-64a76e01-c853-4ddb-9fc9-18aa2ee73c69 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:15.828971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-64a76e01-c853-4ddb-9fc9-18aa2ee73c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:15.869272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128cdd7-c6e9-4e19-92bc-5526f9077028 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:15.880075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:15.903351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 328/670] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:15.904569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4307-17bb-4176-b0b6-654116fc3a3f None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.904841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4307-17bb-4176-b0b6-654116fc3a3f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.905112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b4307-17bb-4176-b0b6-654116fc3a3f None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.906357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 329/671] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:15.907138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b4307-17bb-4176-b0b6-654116fc3a3f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:15.914362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ded0d-77d2-4e52-bd0f-ebe655867260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:15.915218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ded0d-77d2-4e52-bd0f-ebe655867260 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.915494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ded0d-77d2-4e52-bd0f-ebe655867260 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.915760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ded0d-77d2-4e52-bd0f-ebe655867260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.932015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ded0d-77d2-4e52-bd0f-ebe655867260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:15.933465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ded0d-77d2-4e52-bd0f-ebe655867260 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-b63ded0d-77d2-4e52-bd0f-ebe655867260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:15.957457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:15.958427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:15.959344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:15.959344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:15.959344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:15.960432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 343/672] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:15.961634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421461-486c-4f40-92c8-1c88af9cbf26 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:15.961912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421461-486c-4f40-92c8-1c88af9cbf26 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:15.962180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53421461-486c-4f40-92c8-1c88af9cbf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:15.980184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-53421461-486c-4f40-92c8-1c88af9cbf26 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:15.981359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-53421461-486c-4f40-92c8-1c88af9cbf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:16.017872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.051936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b4307-17bb-4176-b0b6-654116fc3a3f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.061714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 344/673] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:16.062967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421461-486c-4f40-92c8-1c88af9cbf26 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.118094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.121990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.121990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.121990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.135805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.137296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:16.156963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:16.157923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:16.158919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 330/674] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:16.163675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.169683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.186507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53421461-486c-4f40-92c8-1c88af9cbf26 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.223800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.224771 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.225236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.225673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.226476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.227002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.228547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.241967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 345/675] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.243085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.283382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3b056-4859-48a5-a0ee-d696a74a483a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.322168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.322824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.323104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.323374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.324329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.324645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.326233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.343319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 331/676] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.344363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.347676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.369961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de92e8-7f19-4f13-b314-f290789a48bd None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.413286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.413838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.414116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.414377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.425779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:16.431748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:16.432904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:16.433961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 346/677] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:16.434826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.450982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.453226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d983ce-051b-4097-b2d5-83b3702c3e76 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.490434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.491347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.491813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.492243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.499418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.501034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:16.513072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:16.514109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:16.515732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:16.517789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 332/678] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:16.518854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.545839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07411ca2-d6ff-4d4d-8609-32e46b88717c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.580992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.581595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.581877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.582149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.582896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=6b18f309b5cb4641997b637f8f17ac87) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.583203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.584635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.586917 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.602714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 347/679] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/role_assignments?user.id=6b18f309b5cb4641997b637f8f17ac87&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.602714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.649357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8823d-a515-4bcb-ac69-bab7de02d4cd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.702748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.703294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.703753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.704025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.704288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.721629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:16.729422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:16.730428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:16.731323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:16.739509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 333/680] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:16.739509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.749520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e3a8-05dc-43d5-8c8c-7edad5785ee6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.790250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.791258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.791747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.792221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.793082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.793556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.796008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.804887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 348/681] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.805957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.858375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab505a-5b19-428a-af51-0cf6a34aecad None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.885816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:16.906684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.907317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.907590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.907854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.908541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.908840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.910270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.923576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 334/682] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.924416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:16.934189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1594-a6f5-4360-9e1e-ccc033c48b18 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:16.974558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:16.975767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:16.976506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:16.976999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:16.977870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:16.978378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:16.980687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:16.996494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 349/683] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:16.996494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.000882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.033218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca229d-5c98-45ae-8d3c-2c040d7a766a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.069802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.070601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.071015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.071380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.082997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.084556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:17.099406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:17.100549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:17.101642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:17.101642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:17.101642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:17.106782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 335/684] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:17.107727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.133915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e28827-ac10-47d2-bff5-5c063c64fd6b None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.145129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.187773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.191273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.191727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.192149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.193439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=c6623b72a17b4f4493e675a344251f7b) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:17.193953 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.196303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.210905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 350/685] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:16 2022] GET /identity/v3/role_assignments?user.id=c6623b72a17b4f4493e675a344251f7b&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:17.210905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.232747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0fc4e-ce6b-47ac-bd6e-dce9ba427212 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.303911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.304729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.305106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.305472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.322785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.325222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.331069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:17.357847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:17.359565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:17.360687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:17.360687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:17.360687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:17.364213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 336/686] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:17.369550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.412127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65bc32-82c6-443d-a700-cbbe2c0d7fcc None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.462463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.462463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.462463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.462463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.462933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:17.462933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.463274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.476307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 351/687] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:17.481890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.503091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.518727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff523c-0ac6-4592-baf9-43bd2bf8e6b7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.556877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.557994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.558530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.560990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.561845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:17.563158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.564744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.579781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 337/688] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:17.586722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.598838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72359d4-f331-47d9-814f-cf7ae635dbba None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.626264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.651790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.652812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.654165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.655840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] PATH_INFO: `/v3/users/swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.668938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.670684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:17.694691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:17.695623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:17.696552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 352/689] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:17.698433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.767329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b84bd5-857c-4981-bbd0-f7655ba396e5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.831402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.832210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.832612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.832975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.850949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.852404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:17.870968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:17.872091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:17.873217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:17.876486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92904a04-1d6b-4236-a0cd-92da751edcff None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:17.884082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 338/690] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:17.892984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:17.906907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:17.947953 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c334d0-1d58-4ed8-96e7-bf4a6ffe91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:17.948788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c334d0-1d58-4ed8-96e7-bf4a6ffe91e0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.949318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c334d0-1d58-4ed8-96e7-bf4a6ffe91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.950241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c334d0-1d58-4ed8-96e7-bf4a6ffe91e0 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.951138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c334d0-1d58-4ed8-96e7-bf4a6ffe91e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:17.951545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c334d0-1d58-4ed8-96e7-bf4a6ffe91e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:17.953594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c334d0-1d58-4ed8-96e7-bf4a6ffe91e0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:17.972963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 353/691] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:17.979105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4866-9450-46a6-95f2-6eac4f7123f6 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:17.979506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4866-9450-46a6-95f2-6eac4f7123f6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:17.979882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc4866-9450-46a6-95f2-6eac4f7123f6 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:17.985662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 354/692] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:17.985662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc4866-9450-46a6-95f2-6eac4f7123f6 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.030022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.044967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e112-cfda-44b3-8bc6-344a86bb6c33 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.081288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99520830-09c1-4423-b2af-64f1f69c3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.082165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99520830-09c1-4423-b2af-64f1f69c3328 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.082697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99520830-09c1-4423-b2af-64f1f69c3328 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.083105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99520830-09c1-4423-b2af-64f1f69c3328 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.084066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99520830-09c1-4423-b2af-64f1f69c3328 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:18.084529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99520830-09c1-4423-b2af-64f1f69c3328 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.086097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99520830-09c1-4423-b2af-64f1f69c3328 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.101824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc4866-9450-46a6-95f2-6eac4f7123f6 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.105665 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 339/693] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:18.107177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553de65-6526-4c86-a0a5-858613023df8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.107588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553de65-6526-4c86-a0a5-858613023df8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.108016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553de65-6526-4c86-a0a5-858613023df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.127717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e553de65-6526-4c86-a0a5-858613023df8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:18.129100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e553de65-6526-4c86-a0a5-858613023df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:18.145262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.146368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.146728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.147056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.197311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.214995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 340/694] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:18.216418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553de65-6526-4c86-a0a5-858613023df8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.229319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.229319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.265718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.372783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 355/695] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:18.380341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.392797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553de65-6526-4c86-a0a5-858613023df8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.463972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.464584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.464860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.465126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.489712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75f9fe-0cee-42c0-9e75-b16b049842b7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.546146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.547106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.547687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.548782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.559381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.567674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.569571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.576280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:18.594949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:18.595920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:18.596804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:18.596804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:18.596804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:18.596982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.597052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.601244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 356/696] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:18.608226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.716663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 341/697] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:18.718000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.762590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33d14f-9ca8-4b37-b28f-014d1df11d28 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.804730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.805727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.806228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.806750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.807607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:18.808114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.809696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.828475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 357/698] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:18.828475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.831914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.839929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea06e6-d017-413a-a50d-326a285a38aa None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.894639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:18.896807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:18.897456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:18.897729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:18.897993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:18.912193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:18.913859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:18.934704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:18.935671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:18.937187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:18.937187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:18.937187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:18.937187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 342/699] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:18.939025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:18.960147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7277f5-a9c8-47ca-b650-008e0d16839e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:18.999448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.000070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.000344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.000609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.010848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.012274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:19.026520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:19.027622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:19.028778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:19.028778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:19.028778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:19.032702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 358/700] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:19.033533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.053066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab6d7-48ee-44ed-8a39-3b354d8d41d9 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.085373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fda53-83ec-4c02-8911-1c872a455c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.086002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fda53-83ec-4c02-8911-1c872a455c6b None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.086280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fda53-83ec-4c02-8911-1c872a455c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.086535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fda53-83ec-4c02-8911-1c872a455c6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.093570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fda53-83ec-4c02-8911-1c872a455c6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.095042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fda53-83ec-4c02-8911-1c872a455c6b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-3f9fda53-83ec-4c02-8911-1c872a455c6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:19.106009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:19.107136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:19.108776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 343/701] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:19.109297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014588c-98bb-4315-9e8a-415caeab0bfd None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.109367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014588c-98bb-4315-9e8a-415caeab0bfd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.109611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014588c-98bb-4315-9e8a-415caeab0bfd None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.114709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 344/702] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:19.114709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014588c-98bb-4315-9e8a-415caeab0bfd None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.121689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:19.145910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e45198-01dc-4a05-b3f9-bbb78ff91079 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.147613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:19.184469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.185168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.185393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.185657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.186316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:19.186621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.188065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.199552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 359/703] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:19.200374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.229497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014588c-98bb-4315-9e8a-415caeab0bfd None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.269565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860852-b549-4d4c-8ca1-0e98b0a22ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.270227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860852-b549-4d4c-8ca1-0e98b0a22ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.270510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860852-b549-4d4c-8ca1-0e98b0a22ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.270804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860852-b549-4d4c-8ca1-0e98b0a22ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.271446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860852-b549-4d4c-8ca1-0e98b0a22ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:19.271745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860852-b549-4d4c-8ca1-0e98b0a22ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.273127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860852-b549-4d4c-8ca1-0e98b0a22ab2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.289808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 345/704] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:19.289808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1f9c4-5656-45c3-a38c-d84a58cddcfa None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.289808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1f9c4-5656-45c3-a38c-d84a58cddcfa None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.289808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1f9c4-5656-45c3-a38c-d84a58cddcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.305851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-63a1f9c4-5656-45c3-a38c-d84a58cddcfa None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:19.307065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-63a1f9c4-5656-45c3-a38c-d84a58cddcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:19.309138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e5d6a-9060-499c-9241-abddae220d87 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.345336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.345942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.346221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.346492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.347203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:19.347505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.348921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.366244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 360/705] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:19.366244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.374371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:19.386707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 346/706] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:19.386707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1f9c4-5656-45c3-a38c-d84a58cddcfa None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.397187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:19.497667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1f9c4-5656-45c3-a38c-d84a58cddcfa None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.501415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd81b0c-cecb-41a8-bea6-9cce9b76def7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.537501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.538496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.538892 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.539542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.543957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.544563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.544842 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.545115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.545792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.546894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.547253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.548425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:19.562007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:19.562977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:19.563872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 347/707] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:19.564375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.627997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:19.666402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 361/708] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:36:19 2022] POST /identity/v3/users => generated 254 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:19.667338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.677400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06849ad-c563-4e44-8091-88de1f682aa3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.717285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.718461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.718765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.719031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.719757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=23992d468c5c427f9cac898359ee569a) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:19.720059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.721501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.730779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 348/709] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/role_assignments?user.id=23992d468c5c427f9cac898359ee569a&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:19.730779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.760313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:19.790475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f7b2-4c8f-4311-849b-9ac3fdb6a4e3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.837357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98807c-8481-4876-8be1-6ee0cb51690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.838159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98807c-8481-4876-8be1-6ee0cb51690f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.838444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98807c-8481-4876-8be1-6ee0cb51690f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.838744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98807c-8481-4876-8be1-6ee0cb51690f None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.839482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98807c-8481-4876-8be1-6ee0cb51690f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:19.839787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98807c-8481-4876-8be1-6ee0cb51690f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.841348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98807c-8481-4876-8be1-6ee0cb51690f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.856450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 362/710] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:19.857915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9dde-7643-4f3b-8a82-9b90d92e7af7 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.858254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9dde-7643-4f3b-8a82-9b90d92e7af7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.858527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a9dde-7643-4f3b-8a82-9b90d92e7af7 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.860270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 363/711] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:19.865470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9dde-7643-4f3b-8a82-9b90d92e7af7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:19.890405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96e64-3ebe-4900-97e7-34ea952a41f4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:19.914150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:19.935429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ffacc-efcf-4ad7-92fa-00b38d3eec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:19.935661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffacc-efcf-4ad7-92fa-00b38d3eec57 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.935848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffacc-efcf-4ad7-92fa-00b38d3eec57 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.936106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ffacc-efcf-4ad7-92fa-00b38d3eec57 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.936733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ffacc-efcf-4ad7-92fa-00b38d3eec57 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:19.938100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ffacc-efcf-4ad7-92fa-00b38d3eec57 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-737ffacc-efcf-4ad7-92fa-00b38d3eec57 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:19.952422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:19.953747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:19.954863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 349/712] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:19.955864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779645a-88dd-4e71-81a6-98de436a1dd2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:19.956962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779645a-88dd-4e71-81a6-98de436a1dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:19.956962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779645a-88dd-4e71-81a6-98de436a1dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:19.979254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b779645a-88dd-4e71-81a6-98de436a1dd2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:19.981301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b779645a-88dd-4e71-81a6-98de436a1dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:20.006871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a9dde-7643-4f3b-8a82-9b90d92e7af7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.046422 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.047156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.047535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.047882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.049215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=47f38d07f1c44175af29a9dfe93f0f37) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:20.049215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:20.050424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:20.056852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 364/713] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:19 2022] GET /identity/v3/role_assignments?user.id=47f38d07f1c44175af29a9dfe93f0f37&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:20.057676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:20.059925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 350/714] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:20.061326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:20.181525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d74fa-c0df-4b19-9593-802b1283d4b4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.219822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.220447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.220719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.220985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.221625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:20.221919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:20.223333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:20.228750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 365/715] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:20.234734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779645a-88dd-4e71-81a6-98de436a1dd2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:20.433965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:20.509557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779645a-88dd-4e71-81a6-98de436a1dd2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.539937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:20.551230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:20.574969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.575586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.575860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.576125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.576783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:20.577607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:20.579003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:20.599163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 351/716] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:20.610928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dcf4a-2157-46b6-9735-28243c003003 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.664475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.665127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.665401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.665668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] PATH_INFO: `/v3/services/network` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.666254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:20.667643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:20.679976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:20.681020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:20.681848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 366/717] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:20.688374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:20.829126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12cef1-9311-4aeb-b498-421969789ded None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:20.871846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670febb-3bbe-4f6e-947b-645770459d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:20.872475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670febb-3bbe-4f6e-947b-645770459d59 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:20.872757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670febb-3bbe-4f6e-947b-645770459d59 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:20.873023 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670febb-3bbe-4f6e-947b-645770459d59 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:20.874182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670febb-3bbe-4f6e-947b-645770459d59 None admin] RBAC: Adding query filter params (name=network) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:20.874485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670febb-3bbe-4f6e-947b-645770459d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:20.875926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670febb-3bbe-4f6e-947b-645770459d59 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:20.886497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 352/718] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:20.892610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:21.010464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297179da-e040-4cbc-8685-75976fa331ed None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:21.041383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:21.048842 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5912f-c74a-4096-9aac-ca63d4b06215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:21.049449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5912f-c74a-4096-9aac-ca63d4b06215 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:21.058173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5912f-c74a-4096-9aac-ca63d4b06215 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:21.058173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5912f-c74a-4096-9aac-ca63d4b06215 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:21.058173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5912f-c74a-4096-9aac-ca63d4b06215 None admin] RBAC: Adding query filter params (type=network) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:21.058173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5912f-c74a-4096-9aac-ca63d4b06215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:21.058173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5912f-c74a-4096-9aac-ca63d4b06215 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:21.058173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 367/719] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:22.360426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81319-43e9-465b-8728-ad9889575344 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.360948 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81319-43e9-465b-8728-ad9889575344 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.360948 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb81319-43e9-465b-8728-ad9889575344 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.362580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 353/720] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:22.367597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452668-0d75-4b34-844f-94eaa02a6c11 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.367991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452668-0d75-4b34-844f-94eaa02a6c11 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.368158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d452668-0d75-4b34-844f-94eaa02a6c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.391411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1d452668-0d75-4b34-844f-94eaa02a6c11 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:22.392602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1d452668-0d75-4b34-844f-94eaa02a6c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:22.433292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac34d-7071-4ef3-825c-8015a66db16f None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.433600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac34d-7071-4ef3-825c-8015a66db16f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.433823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ac34d-7071-4ef3-825c-8015a66db16f None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.435379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 354/721] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:22.441046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48cb6-d072-439e-a293-52f6325616ee None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.441326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48cb6-d072-439e-a293-52f6325616ee None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.441592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e48cb6-d072-439e-a293-52f6325616ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.463471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-21e48cb6-d072-439e-a293-52f6325616ee None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:22.464835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-21e48cb6-d072-439e-a293-52f6325616ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:22.498415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 368/722] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:22.525711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:22.576097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 355/723] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:22.780549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d452668-0d75-4b34-844f-94eaa02a6c11 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:22.863226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a505b-1528-4139-891d-1911ecd41bba None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.863585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a505b-1528-4139-891d-1911ecd41bba None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.863766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a505b-1528-4139-891d-1911ecd41bba None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.865405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 356/724] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:22.869907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51505886-1807-4cf5-bb06-d89096ed5553 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.870537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51505886-1807-4cf5-bb06-d89096ed5553 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.872306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51505886-1807-4cf5-bb06-d89096ed5553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.891311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-51505886-1807-4cf5-bb06-d89096ed5553 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:22.892834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-51505886-1807-4cf5-bb06-d89096ed5553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:22.909144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d452668-0d75-4b34-844f-94eaa02a6c11 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:22.951671 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:22.969035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:22.969924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:22.986869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:22.986869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:22.990742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:22.996396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:22.997357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:22.998195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:23.000253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 357/725] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 09:36:23.000859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 369/726] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:23.001417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51505886-1807-4cf5-bb06-d89096ed5553 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.006078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.171383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a248746-c5cb-4c15-be9a-7cc6adea7fce None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.209944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.210463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.210753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.211019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.211670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:23.211962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:23.213307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:23.221891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51505886-1807-4cf5-bb06-d89096ed5553 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.223509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:23.236372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 370/727] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:23.242155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.289931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.290568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.290877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.291146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.309388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:23.315036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:23.318366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:23.319355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:23.320176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:23.320796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 358/728] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:23.321593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.387631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489566d0-1886-4fc1-b80a-e749d9bab244 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.430806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.431449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.431934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.432207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.442245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1760138-a772-4f3c-91fd-97712d00a6cd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.443302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:23.444799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:23.462935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:23.463892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:23.464766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:23.464766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:23.464766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:23.464766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 371/729] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:23.465485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.482845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959b9fd-4d7d-4186-8906-20c8914ded2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.483488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959b9fd-4d7d-4186-8906-20c8914ded2e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.483761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959b9fd-4d7d-4186-8906-20c8914ded2e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.484028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959b9fd-4d7d-4186-8906-20c8914ded2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.494382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959b9fd-4d7d-4186-8906-20c8914ded2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-f959b9fd-4d7d-4186-8906-20c8914ded2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:23.499160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:23.500066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:23.500890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 359/730] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:23.501562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5091c6-9bdc-4418-af03-75180ea94b2c None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.501970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5091c6-9bdc-4418-af03-75180ea94b2c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.501970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5091c6-9bdc-4418-af03-75180ea94b2c None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.506797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 360/731] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:23.506797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5091c6-9bdc-4418-af03-75180ea94b2c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.535335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:23.581422 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:23.586835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001ecc8-242c-4ea7-b3cd-3b99e09eed9d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.616277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5091c6-9bdc-4418-af03-75180ea94b2c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.621356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.621956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.622231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.622501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.623183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:23.624001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:23.625355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:23.637741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 372/732] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:23.637741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.657982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc23c1-93de-4977-b899-6cc7f5e453db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.658611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc23c1-93de-4977-b899-6cc7f5e453db None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.658938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc23c1-93de-4977-b899-6cc7f5e453db None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.659204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc23c1-93de-4977-b899-6cc7f5e453db None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.659837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc23c1-93de-4977-b899-6cc7f5e453db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:23.660135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc23c1-93de-4977-b899-6cc7f5e453db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:23.661508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc23c1-93de-4977-b899-6cc7f5e453db None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:23.672581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 361/733] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:23.673751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad49bf-197e-4a49-a813-e460e07ce228 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.674032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad49bf-197e-4a49-a813-e460e07ce228 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.674305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad49bf-197e-4a49-a813-e460e07ce228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.696916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-11ad49bf-197e-4a49-a813-e460e07ce228 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:23.698095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-11ad49bf-197e-4a49-a813-e460e07ce228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:23.754112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a6d5-5b97-4aa9-bb0d-15a677677907 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.771865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 362/734] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:23.783521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad49bf-197e-4a49-a813-e460e07ce228 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.790329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.790972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.791250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.791519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.792176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:23.792531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:23.793911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:23.802201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:23.809152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 373/735] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:23.810345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.838275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:23.903157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad49bf-197e-4a49-a813-e460e07ce228 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.919933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b0e09-a8f3-42d6-a1b5-ad616a809c56 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:23.938436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.939088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.939362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.939625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.949458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:23.951172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:23.954959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0857f-60b9-48f3-911b-c45d45ed91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:23.955574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0857f-60b9-48f3-911b-c45d45ed91c2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.955846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0857f-60b9-48f3-911b-c45d45ed91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.956111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0857f-60b9-48f3-911b-c45d45ed91c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.963571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0857f-60b9-48f3-911b-c45d45ed91c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:23.964984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0857f-60b9-48f3-911b-c45d45ed91c2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:23.966680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:23.967627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:23.968630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:23.968630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:23.968630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:23.972417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 363/736] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:23.973255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-d2b0857f-60b9-48f3-911b-c45d45ed91c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:23.978138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:23.979079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:23.980028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:23.984416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 374/737] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:23.985476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba22f-e535-4338-a308-54db00ab2f7a None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:23.985754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba22f-e535-4338-a308-54db00ab2f7a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:23.986023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ba22f-e535-4338-a308-54db00ab2f7a None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:23.987521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 375/738] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:23.988213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ba22f-e535-4338-a308-54db00ab2f7a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.042795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.075434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.081894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f9a7-3303-402a-88d5-f63a49629821 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.093277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ba22f-e535-4338-a308-54db00ab2f7a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.114611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.115255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.115525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.115802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.126369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbc351-b443-4bdf-ae2f-1e963ee32772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.126539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.126995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbc351-b443-4bdf-ae2f-1e963ee32772 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.127319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbc351-b443-4bdf-ae2f-1e963ee32772 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.127631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbc351-b443-4bdf-ae2f-1e963ee32772 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.127968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.128507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbc351-b443-4bdf-ae2f-1e963ee32772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:24.129143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbc351-b443-4bdf-ae2f-1e963ee32772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.131286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbc351-b443-4bdf-ae2f-1e963ee32772 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:24.141672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:24.142966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:24.143872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:24.143872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:24.143872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:24.143872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 364/739] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:24.143872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.144146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 376/740] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:24.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4305-b093-4a95-9e5b-b33e74961909 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.145224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4305-b093-4a95-9e5b-b33e74961909 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.145488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb4305-b093-4a95-9e5b-b33e74961909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.163417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-dabb4305-b093-4a95-9e5b-b33e74961909 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:24.164587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dabb4305-b093-4a95-9e5b-b33e74961909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:24.229668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 377/741] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 09:36:24.230472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb4305-b093-4a95-9e5b-b33e74961909 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.245881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035a217-e1d1-45f4-b3b8-0692e7e7ed81 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.263622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.282271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.282909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.283189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.283573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.284292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:24.284592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.286021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.301605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.309848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 365/742] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 09:36:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:24.309848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.333945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb4305-b093-4a95-9e5b-b33e74961909 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.369849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.370777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.371232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.371641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.372527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.374249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.409846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9378b18-1111-468a-b65e-ed6cdb588881 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.442638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.443423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.443701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.443968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.450862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.452319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:24.463671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:24.466701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:24.468133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:24.468652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 378/743] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:24 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:24.468652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.470060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 366/744] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:36:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:24.475077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.520185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.599300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d6c68-0e88-4054-a507-6b9413d3f7e1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.601856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d327c-004b-4012-8b3b-9a2cf8caafae None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.632429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.639614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.640226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.645105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.645105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.645286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.645286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.645286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.645286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.645539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:24.645539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.645539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.657817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 379/745] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:24.658915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.722901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.724571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.759606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.770004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77254ed9-7cee-4980-912f-c21441011d21 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.809620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.810398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.810695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.811004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.811792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:24.812096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.813520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.830481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 367/746] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 09:36:24.831650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.836477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 380/747] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 09:36:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:24.837356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:24.888581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.936565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7742252-1ac3-49c4-806a-42671e513714 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.950174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a063b-ca7d-4906-bdc1-22f863f718ff None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:24.970708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.971790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.972068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.972331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.972972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.974792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:24.979134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:24.987326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:24.987953 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:24.988221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:24.988483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:24.995407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:24.996837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:25.008050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:25.009144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 381/748] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:25.010688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.078999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 368/749] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:24 2022] POST /identity/v3/services => generated 240 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:25.086112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.121954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefb793-af07-4004-857c-f645e1c6bb77 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.131161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:25.185104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.185657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.186638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.186776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.200769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.202698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1ab39-f792-4632-8b3e-418244ef476e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.202906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:25.219488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:25.220503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:25.221837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:25.221837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:25.221837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:25.221837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 382/750] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:25.223189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.247723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.248865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.249142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.249405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.337459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:25.343072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.345439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.348008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f4694-fe0f-42bb-b3f6-f75b0b0349d0 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.394498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.395576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.396065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.396765 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.398567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:25.399132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.400849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.422387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 383/751] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:25.423752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.439823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:25.460127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 369/752] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:25.465484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.538431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f2a06-ec30-44df-a948-0308c569f8b3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.563303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:25.569709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888d36-473d-4e7b-9ddb-6ddf1480d987 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.577642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.578560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.579055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.579493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.585511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:25.585511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.585511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.600099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 384/753] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:25.601260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.603888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.604519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.604793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.605058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.617355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.618839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:25.634214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:25.635381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:25.636417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:25.636417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:25.636417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:25.636417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 370/754] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:25.636417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.679858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:25.712646 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d67388-9880-462d-8e60-af62af710fb1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.739731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cddd-370c-456b-a60a-912b00ff1877 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.749588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.750474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.750991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.751465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.762654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.764485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.774052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.774749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.775026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.775295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:25.781610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:25.782545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:25.783586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:25.783586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:25.783586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:25.783763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.784530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.786189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 385/755] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:25.787330 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:25.801749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:25.802708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:25.803612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:25.807698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 371/756] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:25.808528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.843059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:25.903106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae700f-a1e2-489e-a58b-db871fde87cd None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.929279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:25.940618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.941440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.941860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.942339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.943189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:25.943684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.945235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:25.949414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ee69c-dfbd-4103-85ef-9f13a64e4f47 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:25.962596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 386/757] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:25.964109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:25.988847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:25.989569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:25.989852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:25.990121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:25.990786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:25.991087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:25.992792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.005294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 372/758] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:26.006317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:26.078084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:26.083883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be0b35-0692-4b24-a53b-b8dcde883b4b None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.115741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cb97a-4bc1-4469-92b4-67786cea04d4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.124642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.126451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.126899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.127747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.128850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:26.129297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.131169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.146346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 387/759] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:26.147524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:26.153763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.158444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.158444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.158444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.163394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.165219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:26.177855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:26.178782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:26.179681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:26.182082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 373/760] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:26.183154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:26.204420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:26.273062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc1ff-3e80-4ffb-b948-7df81c9a3036 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.298934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fc0f3-7fbe-48fb-a4a8-660b1d258d11 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.311853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.312613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.312987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.313371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.321733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.323342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.328397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:26.337306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.338154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.338639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:26.339037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:26.344410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:26.345599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:26.346127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.346127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=23992d468c5c427f9cac898359ee569a) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:26.346127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.346369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 388/761] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:26.346369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:26.346517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.352011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 374/762] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:26 2022] GET /identity/v3/role_assignments?user.id=23992d468c5c427f9cac898359ee569a&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:26.353114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:26.549887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44c415-8d5b-4eeb-8c7d-f3b35dc83f72 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.554440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4eb6a-777c-4074-b8b9-2b17301fe7c3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.558607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:26.598114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.599241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.599700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.600924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.601821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:26.602274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.604352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.619412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 389/763] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:26.626129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:26.646386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.647264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.647698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.648393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.649237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:26.649939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.652174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.678710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 375/764] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:26.684857 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:26.766285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:26.785199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14960a1-6967-4771-968d-6dc11b71202b None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.822870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.823529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.823815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.824074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/47f38d07f1c44175af29a9dfe93f0f37/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.825972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=47f38d07f1c44175af29a9dfe93f0f37, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.827991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.837014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02149ff5-859c-4037-b926-b6a23ad4b89c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:26.877061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e97cc-7b3f-492e-935d-44843cc6caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:26.877670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e97cc-7b3f-492e-935d-44843cc6caba None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.877947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e97cc-7b3f-492e-935d-44843cc6caba None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.878213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e97cc-7b3f-492e-935d-44843cc6caba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.878954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e97cc-7b3f-492e-935d-44843cc6caba None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=3c1c66c9a43b41e89551ad02466a691e) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:26.879257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e97cc-7b3f-492e-935d-44843cc6caba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:26.880679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e97cc-7b3f-492e-935d-44843cc6caba None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:26.887442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 376/765] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:26 2022] GET /identity/v3/role_assignments?user.id=3c1c66c9a43b41e89551ad02466a691e&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:26.888279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9a75-0769-4a63-8238-6670beca6381 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.888279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9a75-0769-4a63-8238-6670beca6381 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.888460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9a75-0769-4a63-8238-6670beca6381 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.894660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 377/766] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:26.896106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce477-aef5-4549-a6eb-29e617c2a75c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:26.896390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce477-aef5-4549-a6eb-29e617c2a75c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:26.896672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ce477-aef5-4549-a6eb-29e617c2a75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:26.909003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 390/767] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:26 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/47f38d07f1c44175af29a9dfe93f0f37/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:26.928487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0f2ce477-aef5-4549-a6eb-29e617c2a75c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:26.929827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0f2ce477-aef5-4549-a6eb-29e617c2a75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:27.037036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 378/768] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:27.409308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:27.435592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:27.489866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d564e-4c0b-408d-88ba-2191f0c5ef8b None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:27.489866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d564e-4c0b-408d-88ba-2191f0c5ef8b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:27.489866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d564e-4c0b-408d-88ba-2191f0c5ef8b None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:27.491775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 379/769] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:27.496439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2b4cf-b525-4f02-b2bc-d18bb96e3972 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:27.496860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2b4cf-b525-4f02-b2bc-d18bb96e3972 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:27.497148 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2b4cf-b525-4f02-b2bc-d18bb96e3972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:27.516619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe715f-88e7-45f6-9a79-3ded2868d9d2 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:27.519273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f8d2b4cf-b525-4f02-b2bc-d18bb96e3972 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:27.521255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f8d2b4cf-b525-4f02-b2bc-d18bb96e3972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:27.578858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:27.579516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:27.579757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:27.580024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:27.580605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:27.581960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:27.599086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:27.602232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:27.603254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:27.604088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:27.605682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 391/770] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Oct 28 09:36:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:27.612904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:27.656703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 380/771] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:27.761346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:27.782833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48314a3d-72aa-4466-a24e-292d50218cae None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:27.832129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:27.832739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:27.833019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:27.833284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:27.833905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:27.834201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:27.835588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:27.844271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 392/772] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 09:36:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:27.850096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2b4cf-b525-4f02-b2bc-d18bb96e3972 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:27.979160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.032861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2b4cf-b525-4f02-b2bc-d18bb96e3972 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.073238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.074210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.074868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.077062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.078575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:28.079735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.081457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.091311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 381/773] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 09:36:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:28.097427 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.148360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:28.176610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bd7d5-5912-4d6f-b85c-6fd85e921a18 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.208912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650768ed-c693-4296-9254-085b63e6ced2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.242905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.243888 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.247407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.247894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] PATH_INFO: `/v3/services/network` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.249257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.250843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:28.264382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:28.265415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:28.266254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:28.269147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 393/774] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:27 2022] GET /identity/v3/services/network => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:28.274919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.292504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.293126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.293395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.293658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.294358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] RBAC: Adding query filter params (interface=public, service_id=6761ccf99e024b85a2be75853796e3e1, region_id=RegionOne) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:28.294661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.296127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.306006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 382/775] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/endpoints?service_id=6761ccf99e024b85a2be75853796e3e1&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:28.313235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.319509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:28.441947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9ec9-c0a8-42d3-8c59-f85c54107609 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.486762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.487658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.488115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.488559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.489379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] RBAC: Adding query filter params (name=network) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:28.489855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.491423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.501327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 394/776] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:28.510702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.510837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad83a6d-e7ab-4e9a-b140-d7d5cced46c9 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.511741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:28.546922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdccaed-9dd5-4984-9ff9-a92f943e1438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.547533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdccaed-9dd5-4984-9ff9-a92f943e1438 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.547863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdccaed-9dd5-4984-9ff9-a92f943e1438 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.548136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdccaed-9dd5-4984-9ff9-a92f943e1438 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.549087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdccaed-9dd5-4984-9ff9-a92f943e1438 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.550619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdccaed-9dd5-4984-9ff9-a92f943e1438 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.556423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 383/777] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:28.696902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:28.726958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2c6ce-f1af-4915-94c1-ed07758c3792 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.779099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168875-7813-46f3-8dcd-b6028882b319 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.780212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.780634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.780913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.781181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.781381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168875-7813-46f3-8dcd-b6028882b319 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.781812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] RBAC: Adding query filter params (type=network) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:28.782060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168875-7813-46f3-8dcd-b6028882b319 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.782159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.783490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.784279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 384/778] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:28.792389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01db53-a684-4aad-ace4-0187a9a81413 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.792672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01db53-a684-4aad-ace4-0187a9a81413 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.792945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01db53-a684-4aad-ace4-0187a9a81413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.794428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 395/779] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:28.800448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:28.820404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6a01db53-a684-4aad-ace4-0187a9a81413 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:28.823187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6a01db53-a684-4aad-ace4-0187a9a81413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:28.936207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 385/780] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:28.938469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f3c7-decc-4fab-b69a-24edceccbd19 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:28.985192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:28.985863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:28.986143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:28.986411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:28.987136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] RBAC: Adding query filter params (interface=public, service_id=5c8059753849410785e15b8d20a5aa09, region_id=RegionOne) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:28.987439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:28.988798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:28.997272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 396/781] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:28 2022] GET /identity/v3/endpoints?service_id=5c8059753849410785e15b8d20a5aa09&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:29.003181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01db53-a684-4aad-ace4-0187a9a81413 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:29.136333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:29.143532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01db53-a684-4aad-ace4-0187a9a81413 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:29.188834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb3948-a9d0-4bad-9cb1-536af01b8c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:29.189466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb3948-a9d0-4bad-9cb1-536af01b8c5a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:29.189744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb3948-a9d0-4bad-9cb1-536af01b8c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:29.190013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb3948-a9d0-4bad-9cb1-536af01b8c5a None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:29.190722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb3948-a9d0-4bad-9cb1-536af01b8c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:29.192221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb3948-a9d0-4bad-9cb1-536af01b8c5a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:29.201581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 386/782] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:29 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:29.402029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:29.412244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd4f5-10b3-4ff3-b3ed-6df14c52fd32 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:29.412897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd4f5-10b3-4ff3-b3ed-6df14c52fd32 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:29.413372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacd4f5-10b3-4ff3-b3ed-6df14c52fd32 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:29.414680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:29.415395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 387/783] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:29.421603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57d9fb-9b70-468e-85ca-79d1187520f8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:29.421881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57d9fb-9b70-468e-85ca-79d1187520f8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:29.422152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57d9fb-9b70-468e-85ca-79d1187520f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:29.455322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4e57d9fb-9b70-468e-85ca-79d1187520f8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:29.456745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4e57d9fb-9b70-468e-85ca-79d1187520f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:29.534144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ad79-f8d4-46f9-ab4c-398387e64dbc None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:29.550635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 388/784] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:29.588389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7982a1-c0ee-465e-86bf-5e0b6d6abd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:29.589357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7982a1-c0ee-465e-86bf-5e0b6d6abd2f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:29.589832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7982a1-c0ee-465e-86bf-5e0b6d6abd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:29.590298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7982a1-c0ee-465e-86bf-5e0b6d6abd2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:29.612800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7982a1-c0ee-465e-86bf-5e0b6d6abd2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-de7982a1-c0ee-465e-86bf-5e0b6d6abd2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:29.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:29.619470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:29.620370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:29.622774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 397/785] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:29.628885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57d9fb-9b70-468e-85ca-79d1187520f8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:29.764733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:29.778964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57d9fb-9b70-468e-85ca-79d1187520f8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:29.810594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8e00-51dc-4b3b-9184-d7a63b4bfa6e None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:29.811121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8e00-51dc-4b3b-9184-d7a63b4bfa6e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:29.811197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8e00-51dc-4b3b-9184-d7a63b4bfa6e None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:29.812757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 398/786] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:29.818494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3377-b032-4901-bf7e-35c26d014c18 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:29.818810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3377-b032-4901-bf7e-35c26d014c18 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:29.819086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3377-b032-4901-bf7e-35c26d014c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:29.828835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:29.829439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:29.829712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:29.829975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:29.830628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:29.830956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:29.832492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:29.837965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-adcd3377-b032-4901-bf7e-35c26d014c18 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:29.839184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-adcd3377-b032-4901-bf7e-35c26d014c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:29.845814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 389/787] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:29.851517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:29.917673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 399/788] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:29.919010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:29.952537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3377-b032-4901-bf7e-35c26d014c18 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.037435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15482b-53aa-4ff2-94d5-c21760c3f64f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.093675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3377-b032-4901-bf7e-35c26d014c18 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.114481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.120352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.120352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.120352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.138301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.140304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.161489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.164319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.164599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.164872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:30.173913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:30.174874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:30.175777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:30.175777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:30.175777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:30.177847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 390/789] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:30.180996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.185192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:30.186401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:30.196930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:30.201722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:30.202641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 400/790] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:30.210274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.289034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:30.335303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a2615-2724-4268-9ca0-b8f43b09d816 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.345313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e78793-39ce-4297-b712-11b715b7d43c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.372749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.374152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.374629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.375186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.376062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:30.376559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.378121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.392189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 401/791] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:30.392189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.392791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.393402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.393678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.393973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.394621 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:30.394960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.396385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.413084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 391/792] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:30.414307 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.495436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:30.521137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a09dd-3600-4aca-b7b7-07d512b5f4fc None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.538694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452ec10-5efe-4aed-8b24-87519617a05a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.544216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:30.559962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.561124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.561468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.561811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.574040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:30.575740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.577120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.577609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.578057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:30.581401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:30.582320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:30.583191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:30.587746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 402/793] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:30.588590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.594138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.595860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:30.611467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:30.612439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:30.613310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:30.613310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:30.613310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:30.616247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 392/794] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:30.617359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.714173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4dd055-58b2-4e7f-a065-fc6eeae9d448 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.734694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be88646-45b4-45ee-9dc9-6b6c9467f16a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.751526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:30.752032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.753442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.753925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.754352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.763290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.765006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.769694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.770296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.770568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.770861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.771523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:30.771821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.773522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:30.779275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:30.780390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:30.781497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:30.783726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 403/796] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:30.784758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.786495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 393/796] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:30.787402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.833717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:30.895667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29f4dc-0c32-4fde-8671-f13afeaf94c9 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.897346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e29e94-4e7c-4bbc-939d-7f37adff9de3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:30.933127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.934087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.934604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.935079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.935214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:30.936642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:30.937088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:30.937429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:30.938170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:30.938542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.940172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.949465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:30.951366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:30.959134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 404/797] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:30.960085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:30.967769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:30.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:30.970031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:30.970031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:30.970031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:30.971835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 394/798] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:30.977086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.047203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.064222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.067045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9a0a-c479-462a-9714-c22e49568235 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.083868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60f53e-dc87-4861-8b90-eee460ec4776 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.101526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.102129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.102411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.102697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.103421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:31.103720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.105161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.122114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2843ab-06f4-41bd-a31f-46b496cb9855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.123479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2843ab-06f4-41bd-a31f-46b496cb9855 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.123592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2843ab-06f4-41bd-a31f-46b496cb9855 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.123854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2843ab-06f4-41bd-a31f-46b496cb9855 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.125960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 405/799] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:31.126639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.136349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2843ab-06f4-41bd-a31f-46b496cb9855 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.137853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2843ab-06f4-41bd-a31f-46b496cb9855 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-eb2843ab-06f4-41bd-a31f-46b496cb9855 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:31.149994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:31.155726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 395/800] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:36:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02189-3b32-45b0-b2d6-5ac69df30697 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.156657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02189-3b32-45b0-b2d6-5ac69df30697 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.157344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d02189-3b32-45b0-b2d6-5ac69df30697 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.157344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 396/801] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:31.157344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02189-3b32-45b0-b2d6-5ac69df30697 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.241529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2826a-12e4-4440-9dd6-91a184eb5782 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.251647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.262635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d02189-3b32-45b0-b2d6-5ac69df30697 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.277952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.278562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.278873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.279170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.279808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:31.280098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.281625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.298138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 406/802] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:31.298902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.299095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193fc2e-f540-4cb7-b2c0-5e63927af6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.299704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193fc2e-f540-4cb7-b2c0-5e63927af6d1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.299978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193fc2e-f540-4cb7-b2c0-5e63927af6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.300242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193fc2e-f540-4cb7-b2c0-5e63927af6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.310911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193fc2e-f540-4cb7-b2c0-5e63927af6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.312361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193fc2e-f540-4cb7-b2c0-5e63927af6d1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.318497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-2193fc2e-f540-4cb7-b2c0-5e63927af6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:31.327981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:31.328931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:31.329833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:31.329833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:31.329833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:31.329833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 397/803] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:31.330521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e6dc-b15c-4186-a18b-ba1e36607305 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.330621 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e6dc-b15c-4186-a18b-ba1e36607305 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.330844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e6dc-b15c-4186-a18b-ba1e36607305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.349699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0403e6dc-b15c-4186-a18b-ba1e36607305 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:31.350962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0403e6dc-b15c-4186-a18b-ba1e36607305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:31.415177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d29c17-204c-4ec8-83ad-1acd466efa75 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.419400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 398/804] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:31.420745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e6dc-b15c-4186-a18b-ba1e36607305 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.457295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.457933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.458659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.459041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.460052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:31.460357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.461786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.481720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 407/805] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:31.482948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.501745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.534074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e6dc-b15c-4186-a18b-ba1e36607305 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.569244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.570195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.570723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.571179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.579155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.581038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.582889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:31.597679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:31.605957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:36:31.606935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:31.607527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80869281-1942-4c58-9e98-b7298d076682 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.607613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 399/806] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:31.608535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.644885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.645494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.645769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.646038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.646875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:31.647179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.649584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.667339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 408/807] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:31.667339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.723359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb9df-375f-4662-ba97-04f67a8a1b18 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.751615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.756147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.756770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.763293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.763293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.768357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.768597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fae87e-3de1-4dfc-b790-04c532b17740 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.769795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:31.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:31.785933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:31.787038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:31.787038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:31.787038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:31.787038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 400/808] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:31.787508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.807416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a276e12-975e-4a63-b88c-2de595dc9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.808023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276e12-975e-4a63-b88c-2de595dc9db1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.808302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276e12-975e-4a63-b88c-2de595dc9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.808573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276e12-975e-4a63-b88c-2de595dc9db1 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.809327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a276e12-975e-4a63-b88c-2de595dc9db1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:31.809630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a276e12-975e-4a63-b88c-2de595dc9db1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.811595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a276e12-975e-4a63-b88c-2de595dc9db1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.814073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:31.833928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 409/809] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:31.833928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5549e0-4ceb-47df-91f3-37b84f72d6f1 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.833928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5549e0-4ceb-47df-91f3-37b84f72d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.833928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5549e0-4ceb-47df-91f3-37b84f72d6f1 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.833928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 410/810] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:31.833928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5549e0-4ceb-47df-91f3-37b84f72d6f1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.893140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49aa6-3c50-4223-a943-6e058cc93484 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.925614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.926241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.926514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.926812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.933456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.934928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.936195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5549e0-4ceb-47df-91f3-37b84f72d6f1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:31.946447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:31.947337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 401/811] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:31.948820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.975693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:31.976312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:31.976583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:31.976853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:31.977421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:31.978801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:31.987318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:31.988347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:31.989183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 411/812] 10.222.0.49 () {56 vars in 1129 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:31.993831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:31.996559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.050037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c5421-1ad3-4310-9e9c-3e8b3e0b135f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.052556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.084922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba53907-6e84-41bb-a8fe-b6e35dcab77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.085460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53907-6e84-41bb-a8fe-b6e35dcab77c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.085734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53907-6e84-41bb-a8fe-b6e35dcab77c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.086000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53907-6e84-41bb-a8fe-b6e35dcab77c None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.086643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba53907-6e84-41bb-a8fe-b6e35dcab77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:32.086979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba53907-6e84-41bb-a8fe-b6e35dcab77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.088356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba53907-6e84-41bb-a8fe-b6e35dcab77c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.093549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4917ee2-5352-41f4-9b10-12b2298d9ab4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.099582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 402/813] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:32.100848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e028e-1ac7-4147-a97c-57a27b257ea9 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.101028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e028e-1ac7-4147-a97c-57a27b257ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.101276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e028e-1ac7-4147-a97c-57a27b257ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.118934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e74e028e-1ac7-4147-a97c-57a27b257ea9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:32.120114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e74e028e-1ac7-4147-a97c-57a27b257ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:32.131109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.131710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.131983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.132248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.188185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 403/814] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:32.189010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e028e-1ac7-4147-a97c-57a27b257ea9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.205997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.207479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.226069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.267831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.295682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e028e-1ac7-4147-a97c-57a27b257ea9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.318967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 412/815] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:32.318967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.332904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.333514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.333791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.334060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.334775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:32.335131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.336495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.347593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 404/816] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:32.348505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.429117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9352f6-d097-4001-aab6-8b20a228b552 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.444568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.452800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c64508-e458-4bfb-bda3-aee2c8a31ad1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.465316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.465921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.466197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.466465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.467146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:32.467444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.468796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.473135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 413/817] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:32.473905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.487813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.488442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.488717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.488991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.495514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.496983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.497391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:32.508607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:32.510143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 405/818] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:32.511192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.572991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12320a-dff6-44af-88ce-64c08a3ac0ec None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.606220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.606802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.607074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.607905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.610505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257f516-a4fc-4f9d-98f3-a52c91934e5e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.617691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.619181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:32.634867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:32.635833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:32.636732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:32.636732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:32.636732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:32.636732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 414/819] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:32.636732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.647022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.647702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.648231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.648510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/23992d468c5c427f9cac898359ee569a/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.650457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=23992d468c5c427f9cac898359ee569a, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.651959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.723750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 406/820] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:32 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/23992d468c5c427f9cac898359ee569a/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:32.724597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.755666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.834089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:32.853075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca69946-dcb1-4c3e-923d-f675a937a5f8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.864548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05122c-8322-4f6a-8f05-ad3d916357c3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:32.889760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.890376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.890654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.890950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.891587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:32.891889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.893301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.901414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 407/821] 10.222.0.49 () {56 vars in 1124 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:32.901580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.909872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:32.910484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:32.910795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:32.911070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] PATH_INFO: `/v3/services/network` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:32.911654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:32.913015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:32.922898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:32.923921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:32.924759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 415/822] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/services/network => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:32.925544 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:32.985771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:33.007050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b470089-c2b0-46f7-9383-05d3069726d8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.035181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e286b-7bc5-4fb2-b341-1fd57c786a49 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.041708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.042311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.042584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.042877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.043553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:33.043856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.045383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.057311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 408/823] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:33.058108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.076484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.077086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.077652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.077922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.078554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:33.078881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.080662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.088025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:33.098110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 416/824] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:33.098110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.169172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033736e-e42a-4a62-8672-f42755e73766 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.202945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba4804-3f82-4b0c-8b57-0fcb7b0b08d4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.213437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.214039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.214314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.214580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.215274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.217261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.226268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:33.239007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.239832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.243769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.243769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.243769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] RBAC: Adding query filter params (name=network) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:33.243769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.243769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.247254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 417/825] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:33.248033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.311348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:33.354704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 409/826] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:33.354704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.359021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d568303-9f31-4c84-b591-06889a3b9463 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.420384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.421102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.421378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.421641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/3c1c66c9a43b41e89551ad02466a691e/roles/e8a675fd394b45de927f3b1058683873` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.439373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=3c1c66c9a43b41e89551ad02466a691e, role_id=e8a675fd394b45de927f3b1058683873)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.440904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.495264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9ab70-05b4-4ec7-bf70-8f0b21ca48d4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.514405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 418/827] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:33 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/3c1c66c9a43b41e89551ad02466a691e/roles/e8a675fd394b45de927f3b1058683873 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:33.515687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.551185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.552203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.552628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.553920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.562303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.564050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:33.579650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:33.580624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:33.581505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:33.585839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 410/828] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:33.587405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.658837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2062e-573f-46ca-8e43-c4a38b6951c4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.661240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:33.673652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:33.702534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.703397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.703697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.704087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.706406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] RBAC: Adding query filter params (type=network) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:33.706622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.708156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.716503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 419/829] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:33.723357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.734819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a123-6020-4b1b-97b2-28abe4d954cd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.778655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.779849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.780323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.780765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.781787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:33.782277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.784589 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.801717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 411/830] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:33.808597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:33.853338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351bc2b-d60b-4d5b-8352-19288e9eb140 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.909221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b127ec-9a3b-4e43-81af-804b7da77e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:33.910211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b127ec-9a3b-4e43-81af-804b7da77e74 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:33.910809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b127ec-9a3b-4e43-81af-804b7da77e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:33.911280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b127ec-9a3b-4e43-81af-804b7da77e74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:33.912361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b127ec-9a3b-4e43-81af-804b7da77e74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:33.913931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b127ec-9a3b-4e43-81af-804b7da77e74 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:33.972209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507cf51-b5e4-4776-b241-85a1ea125afd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:33.989099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:34.009464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028862e-e3f3-43e8-b725-07b3a7d14b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:34.010073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028862e-e3f3-43e8-b725-07b3a7d14b94 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:34.010349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028862e-e3f3-43e8-b725-07b3a7d14b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:34.010605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028862e-e3f3-43e8-b725-07b3a7d14b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:34.011358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028862e-e3f3-43e8-b725-07b3a7d14b94 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=47f38d07f1c44175af29a9dfe93f0f37) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:34.011661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028862e-e3f3-43e8-b725-07b3a7d14b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:34.013280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028862e-e3f3-43e8-b725-07b3a7d14b94 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:34.019795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 412/831] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:33 2022] GET /identity/v3/role_assignments?user.id=47f38d07f1c44175af29a9dfe93f0f37&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:34.021060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 420/832] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:36:35.035510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba29580-220b-405a-a528-04da2ba8afec None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.036002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba29580-220b-405a-a528-04da2ba8afec None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.036002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba29580-220b-405a-a528-04da2ba8afec None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.037600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 413/833] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:35.042838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303898bf-2dfe-4cea-a72f-c00afc7decc1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.043269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303898bf-2dfe-4cea-a72f-c00afc7decc1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.043442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303898bf-2dfe-4cea-a72f-c00afc7decc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.063883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-303898bf-2dfe-4cea-a72f-c00afc7decc1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:35.065074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-303898bf-2dfe-4cea-a72f-c00afc7decc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:35.090055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:35.174047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 421/834] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:35.444747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba29580-220b-405a-a528-04da2ba8afec None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:35.551461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba29580-220b-405a-a528-04da2ba8afec None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:35.587022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:35.587647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.587917 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.588186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.599211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:35.604053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:35.605045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:35.605882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 414/835] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:35.611419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303898bf-2dfe-4cea-a72f-c00afc7decc1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:35.726502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303898bf-2dfe-4cea-a72f-c00afc7decc1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:35.761399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cca9e-539a-46f4-a56c-d7d097dffd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:35.762011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cca9e-539a-46f4-a56c-d7d097dffd18 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.762288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cca9e-539a-46f4-a56c-d7d097dffd18 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.762559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cca9e-539a-46f4-a56c-d7d097dffd18 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.763808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cca9e-539a-46f4-a56c-d7d097dffd18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:35.764119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cca9e-539a-46f4-a56c-d7d097dffd18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:35.765482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cca9e-539a-46f4-a56c-d7d097dffd18 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:35.774421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 422/836] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:35.779930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:35.795486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717270a-7a9a-4034-b918-f852b62f9c6c None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.795778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717270a-7a9a-4034-b918-f852b62f9c6c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.796058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717270a-7a9a-4034-b918-f852b62f9c6c None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.798035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 423/837] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:35.803501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523fc06-a79a-4898-a6a2-588272864b40 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.803780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523fc06-a79a-4898-a6a2-588272864b40 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.804054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523fc06-a79a-4898-a6a2-588272864b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.824982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:35.827947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0523fc06-a79a-4898-a6a2-588272864b40 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:35.829716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0523fc06-a79a-4898-a6a2-588272864b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:35.843330 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:35.894261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433527c8-9d20-477a-8fc7-12958d78dc8a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:35.918710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 424/838] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:35.940239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce66a6-729f-4958-aa01-b351f59bb1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:35.940881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce66a6-729f-4958-aa01-b351f59bb1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:35.941161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce66a6-729f-4958-aa01-b351f59bb1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:35.941434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce66a6-729f-4958-aa01-b351f59bb1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:35.952324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce66a6-729f-4958-aa01-b351f59bb1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:35.953895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce66a6-729f-4958-aa01-b351f59bb1b9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-29ce66a6-729f-4958-aa01-b351f59bb1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:35.969499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:35.970453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:35.971367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:35.971367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:35.971367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:35.971367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 415/839] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:35.979860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523fc06-a79a-4898-a6a2-588272864b40 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.019029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3298f6e-fac4-4577-9bc5-1104b4883c97 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.019345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3298f6e-fac4-4577-9bc5-1104b4883c97 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.019571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3298f6e-fac4-4577-9bc5-1104b4883c97 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.022175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 416/840] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:36.026376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c6c6-b8c2-4ff8-96d2-87466e8260db None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.026657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c6c6-b8c2-4ff8-96d2-87466e8260db None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.026977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02c6c6-b8c2-4ff8-96d2-87466e8260db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.045672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-aa02c6c6-b8c2-4ff8-96d2-87466e8260db None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:36.046875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-aa02c6c6-b8c2-4ff8-96d2-87466e8260db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:36.096188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523fc06-a79a-4898-a6a2-588272864b40 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.123596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 417/841] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:36.135902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.136515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.136792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.137071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.137706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:36.138006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.139456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.151463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 425/842] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:36.156979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c6c6-b8c2-4ff8-96d2-87466e8260db None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.179562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.228047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.239141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.276603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02c6c6-b8c2-4ff8-96d2-87466e8260db None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.317793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594c7cd-9a87-4a8d-bd5c-785ace115dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.318810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c7cd-9a87-4a8d-bd5c-785ace115dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.319309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c7cd-9a87-4a8d-bd5c-785ace115dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.319773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c7cd-9a87-4a8d-bd5c-785ace115dc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.330941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c7cd-9a87-4a8d-bd5c-785ace115dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.332400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594c7cd-9a87-4a8d-bd5c-785ace115dc3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c594c7cd-9a87-4a8d-bd5c-785ace115dc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:36.344938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:36.345970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:36.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 418/843] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:36.349162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef878b4-eb6b-4989-918b-849d2a410d20 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.349420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef878b4-eb6b-4989-918b-849d2a410d20 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.349696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef878b4-eb6b-4989-918b-849d2a410d20 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.350987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 419/844] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:36.351918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef878b4-eb6b-4989-918b-849d2a410d20 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.355902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327c927-3266-4c2c-b9aa-2b11baf2ac8c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.391381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03826f7-374a-4b82-b328-b07f7646da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.392243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03826f7-374a-4b82-b328-b07f7646da01 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.392673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03826f7-374a-4b82-b328-b07f7646da01 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.393080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03826f7-374a-4b82-b328-b07f7646da01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.393786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03826f7-374a-4b82-b328-b07f7646da01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.395374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03826f7-374a-4b82-b328-b07f7646da01 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-c03826f7-374a-4b82-b328-b07f7646da01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:36.404921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:36.406040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:36.407150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:36.410616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 426/845] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:36.411828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eee9d-a3df-4e47-a3ac-871d5b3ae2c3 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.412111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eee9d-a3df-4e47-a3ac-871d5b3ae2c3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.412375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eee9d-a3df-4e47-a3ac-871d5b3ae2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.433262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-979eee9d-a3df-4e47-a3ac-871d5b3ae2c3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:36.434447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-979eee9d-a3df-4e47-a3ac-871d5b3ae2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:36.438206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.457814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef878b4-eb6b-4989-918b-849d2a410d20 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.492330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.492868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.493147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.493418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.494134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:36.494436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.495886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.496990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.501572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 427/846] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:36.502217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eee9d-a3df-4e47-a3ac-871d5b3ae2c3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.516467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 420/847] 10.222.0.49 () {56 vars in 1135 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:36.520206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.607862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eee9d-a3df-4e47-a3ac-871d5b3ae2c3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.621366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a1beb-9c50-4baf-9ffc-652766844b59 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.645117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.645746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.646018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.646284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.657393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:36.658476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.659171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.659523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.659882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.660575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:36.660951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:36.662129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:36.663034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:36:36.663906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:36.664544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.668274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 428/848] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:36.673974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 421/849] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:36.674119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.674211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.676532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.736091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.779408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872fcaae-9c74-43bc-9b15-a3ac18c8aa33 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.780250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b12a88-21ce-4afb-b231-dd1206e4b3ad None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.812527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.812690 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.813131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.813248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.813402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.813494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.813667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.813766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.814308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:36.814600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.815980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.823501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 422/850] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:36.824274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.885003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.885213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.886434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.922123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217d0a6-3d08-45f5-b227-49caff1b75c1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:36.943066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:36.955608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:36.956222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:36.956495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:36.956756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:36.957365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:36.957657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:36.959027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:36.963731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 423/851] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:36.964519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:36.989753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 429/852] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:36.989753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.098254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6f927-46dc-402a-9c31-7a8afd63a63d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.102199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5a6f4-2c4a-447f-8647-5e1fb8237a3a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.127833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.136221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.136848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.137131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.137402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.137989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.139539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.149414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:37.149826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:37.150902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:37.151844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:37.152581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.152581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.152581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.152768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 424/853] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:37.152768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.167513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.169052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:37.185003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:37.185977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:37.186945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:37.186945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:37.186945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:37.186945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 430/854] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:37.186945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.203037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.262245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d4325-89bf-4abe-a8ca-cab97270b9aa None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.297349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.297561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7451c0e-6d6e-4997-bd86-e0e1fcc8d0af None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.297975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.298247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.298511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.308450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.309888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:37.324456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:37.325461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:37.326381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:37.326381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:37.326381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:37.326381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 425/855] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:37.326381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.338184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.338932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.339206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.339473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.340095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:37.340456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.342528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.351784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 431/856] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:37.351784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.378268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.433062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.434205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b084-cb3f-4d51-a790-43760b6504e3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.458512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc09cc-6d08-4ed5-9185-c0b2c00f6520 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.470423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.471063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.471346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.471641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.472285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:37.472586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.473959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.490529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 426/857] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:37.490529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.500768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.501382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.501654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.501916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.502542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:37.502867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.504210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.520981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 432/858] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:37.520981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.599988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1dc1a-ca98-440a-86c6-73ea1e465009 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.603296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.622803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c9ebd-66a3-40b0-966e-93452c70af2d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.636308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.636927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.637283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.637552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.638712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:37.639014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.640480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.654709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 427/859] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:37.654709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.670987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.671790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.672072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.672341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.676340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.682114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.684481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:37.701142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:37.702116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:37.703077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:37.707307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 433/860] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:37.709132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.811753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0d4af-41ae-4157-8463-9c8662b51c30 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.829797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c14497-2c40-43ec-89d9-f8225c6ac698 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:37.869624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.870196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.870479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.870777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.880015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.884446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:37.884446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:37.884446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:37.884446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:37.884835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:37.884835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:37.885069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.885532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:37.899692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:37.900613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:37.901507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 428/861] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:37.906825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 434/862] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:37.912181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.913193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:37.956306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:37.982364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:38.029469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44078cde-857d-4529-ab58-52b2c65f0620 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.039513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f666a91-8e0e-40d1-8afc-6d8ededfecfd None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.068755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.069548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.069963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.070337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.071207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:38.071598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.073301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.082743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.083347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.083620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.084420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.087579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 429/863] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:38.093384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:38.171768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.173132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.194763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:38.206256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825a833-87ed-4c83-a586-463ed5b63cf7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.243121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:38.257238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.257844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.258114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.258376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.259282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=23992d468c5c427f9cac898359ee569a) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:38.259593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.261105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.269127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 430/864] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:38 2022] GET /identity/v3/role_assignments?user.id=23992d468c5c427f9cac898359ee569a&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:38.299875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 435/865] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:38.306168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:38.423020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c10cb6-8e58-4101-a8f1-3f8d35397ab6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.461054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.461952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.462376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.462828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.476373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.478132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:38.492991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:38.494117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:38.495311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:38.495311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:38.495311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:38.501020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 431/866] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:38.503917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:38.608519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcdc06-c0f3-4c7f-b1de-373412e450c5 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.644709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.645400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.645746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.646127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.646808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:38.647111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.648727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.660901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 436/867] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:38.666395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:38.670594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:38.774594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd3d82-c83f-4c37-935d-96b933c0ac44 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.809705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.810875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.811153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.811422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.818805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.820266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:38.832507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:38.833541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:38.835509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 432/868] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:38.839654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:38.856197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:38.950931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cfa8a-4994-4a88-8f18-97f1811d8174 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:38.985371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d68798-c91d-4765-87c6-068e02776cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:38.986217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68798-c91d-4765-87c6-068e02776cef None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:38.986647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68798-c91d-4765-87c6-068e02776cef None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:38.987092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d68798-c91d-4765-87c6-068e02776cef None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:38.987925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68798-c91d-4765-87c6-068e02776cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:38.988402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68798-c91d-4765-87c6-068e02776cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:38.989966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d68798-c91d-4765-87c6-068e02776cef None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:39.003534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 437/869] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:39.014699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:39.076178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:39.120567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b45bbe-dc2e-4c64-bf23-8b3cc05b7ac8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:39.157730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bcebc-d538-4945-bd27-38a561b9c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:39.158341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bcebc-d538-4945-bd27-38a561b9c482 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:39.158619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bcebc-d538-4945-bd27-38a561b9c482 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:39.158915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bcebc-d538-4945-bd27-38a561b9c482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:39.159635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bcebc-d538-4945-bd27-38a561b9c482 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=3c1c66c9a43b41e89551ad02466a691e) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:39.159941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bcebc-d538-4945-bd27-38a561b9c482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:39.161368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bcebc-d538-4945-bd27-38a561b9c482 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:39.167662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 433/870] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:39 2022] GET /identity/v3/role_assignments?user.id=3c1c66c9a43b41e89551ad02466a691e&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:39.221867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142503-d1db-4da3-85f6-bf3a8b37d0bd None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:39.222397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142503-d1db-4da3-85f6-bf3a8b37d0bd None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:39.222397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0142503-d1db-4da3-85f6-bf3a8b37d0bd None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:39.223922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 438/871] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:39.233230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b26b5-522c-4279-b47d-e243c0a6c264 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:39.233230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b26b5-522c-4279-b47d-e243c0a6c264 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:39.233230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b26b5-522c-4279-b47d-e243c0a6c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:39.251808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-da6b26b5-522c-4279-b47d-e243c0a6c264 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:39.253373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-da6b26b5-522c-4279-b47d-e243c0a6c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:39.334467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 434/872] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:39.599492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142503-d1db-4da3-85f6-bf3a8b37d0bd None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:39.691969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:39.719802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0142503-d1db-4da3-85f6-bf3a8b37d0bd None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:39.756148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f77d9c-173f-4ee3-9cd2-4fd2ffa2ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:39.757045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77d9c-173f-4ee3-9cd2-4fd2ffa2ecf2 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:39.757481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77d9c-173f-4ee3-9cd2-4fd2ffa2ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:39.757996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77d9c-173f-4ee3-9cd2-4fd2ffa2ecf2 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:39.758862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f77d9c-173f-4ee3-9cd2-4fd2ffa2ecf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:39.760356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f77d9c-173f-4ee3-9cd2-4fd2ffa2ecf2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:39.831433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 439/873] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:39 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:39.967419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640c9a-fcee-4456-bd3a-e0d928519aee None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:39.967623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640c9a-fcee-4456-bd3a-e0d928519aee None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:39.967935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640c9a-fcee-4456-bd3a-e0d928519aee None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:39.969577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 435/874] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:39.975282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513dd4-5006-4fd5-8546-b065ea096072 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:39.975869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513dd4-5006-4fd5-8546-b065ea096072 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:39.976359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3513dd4-5006-4fd5-8546-b065ea096072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:39.997236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f3513dd4-5006-4fd5-8546-b065ea096072 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:39.998896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f3513dd4-5006-4fd5-8546-b065ea096072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:40.078314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 440/875] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:40.350248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640c9a-fcee-4456-bd3a-e0d928519aee None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:40.413449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:40.463695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640c9a-fcee-4456-bd3a-e0d928519aee None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:40.500593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:40.501201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:40.501480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:40.501748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:40.502401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:40.503817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:40.550044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d57f16-b455-4742-92b9-0027fad620d4 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:40.550559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d57f16-b455-4742-92b9-0027fad620d4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:40.550637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d57f16-b455-4742-92b9-0027fad620d4 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:40.552099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 441/876] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:40.557069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3cfa-159b-4cb4-b18d-b206e8552750 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:40.557349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3cfa-159b-4cb4-b18d-b206e8552750 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:40.557621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3cfa-159b-4cb4-b18d-b206e8552750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:40.576245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-293f3cfa-159b-4cb4-b18d-b206e8552750 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:40.577414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-293f3cfa-159b-4cb4-b18d-b206e8552750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:40.604835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 436/877] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:40 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:40.648185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:40.671530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 442/878] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:40.943853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:41.049522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e330174-08d4-4a1a-9514-f20c39d5177f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:41.067796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:41.085555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:41.086533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:41.087040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:41.087525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:41.088324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:41.089968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:41.099845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:41.100839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:41.101670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:41.109622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 437/879] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:41.111326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f3cfa-159b-4cb4-b18d-b206e8552750 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:41.220242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f3cfa-159b-4cb4-b18d-b206e8552750 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:41.255824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283c914-2635-4248-b467-20cca7c049ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:41.256796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c914-2635-4248-b467-20cca7c049ea None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:41.257288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c914-2635-4248-b467-20cca7c049ea None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:41.257771 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283c914-2635-4248-b467-20cca7c049ea None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:41.258589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283c914-2635-4248-b467-20cca7c049ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:41.259136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283c914-2635-4248-b467-20cca7c049ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:41.260686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283c914-2635-4248-b467-20cca7c049ea None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:41.266486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 443/880] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:41.271898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:41.375499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d18158-460e-406b-94eb-857bbb44ec3b None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:41.415593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cc097-2ce9-409b-8f14-3fb487c4aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:41.416220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc097-2ce9-409b-8f14-3fb487c4aac6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:41.416497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc097-2ce9-409b-8f14-3fb487c4aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:41.416768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc097-2ce9-409b-8f14-3fb487c4aac6 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:41.417410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cc097-2ce9-409b-8f14-3fb487c4aac6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:41.417713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cc097-2ce9-409b-8f14-3fb487c4aac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:41.419218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cc097-2ce9-409b-8f14-3fb487c4aac6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:41.424976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 438/881] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:41.523500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06748d-38af-4950-8ea9-64a832ae1539 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:41.523884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06748d-38af-4950-8ea9-64a832ae1539 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:41.524337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06748d-38af-4950-8ea9-64a832ae1539 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:41.525796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 444/882] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:41.532428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7585-def7-4745-b2a9-c7c25ed8839a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:41.532860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7585-def7-4745-b2a9-c7c25ed8839a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:41.533241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b7585-def7-4745-b2a9-c7c25ed8839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:41.552802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6b3b7585-def7-4745-b2a9-c7c25ed8839a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:41.554043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6b3b7585-def7-4745-b2a9-c7c25ed8839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:41.604158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:41.634120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 439/883] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:41.910419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06748d-38af-4950-8ea9-64a832ae1539 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:41.969744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:42.023553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06748d-38af-4950-8ea9-64a832ae1539 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.052819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a52d9-c281-4d05-9f73-c20ee61cf01a None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.053114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a52d9-c281-4d05-9f73-c20ee61cf01a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.053377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a52d9-c281-4d05-9f73-c20ee61cf01a None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.058384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 440/884] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:42.059646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dba9-9c3c-4002-a50c-eeeb469794a2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.059932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dba9-9c3c-4002-a50c-eeeb469794a2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.060204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9dba9-9c3c-4002-a50c-eeeb469794a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.068048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.068932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.069417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.069876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.079112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-3ae9dba9-9c3c-4002-a50c-eeeb469794a2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:42.080290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3ae9dba9-9c3c-4002-a50c-eeeb469794a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:42.081752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:42.087002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:42.087914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:42.088756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:42.092060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 445/885] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 09:36:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:42.098515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.166888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 441/886] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:42.221053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76535730-6bec-4071-9f39-4a1f3cd54ecc None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.232184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:42.256661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.257327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.257602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.257872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.258572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:42.258960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:42.260315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:42.269239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 446/887] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:42.275211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9dba9-9c3c-4002-a50c-eeeb469794a2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.382068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9dba9-9c3c-4002-a50c-eeeb469794a2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.389599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:42.417307 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.418037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.418318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.418586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.429469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:42.430969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:42.446227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:42.447245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:42.448115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:42.448115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:42.448115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:42.448115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 442/888] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:42.453337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.487168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.558949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ea5db-3b6a-43c2-9bf4-38e4e7d023ef None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.594127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.594790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.595074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.595345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.595983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:42.596248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb95ae-9083-4094-8be3-34c5748d46a0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.596353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:42.597753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:42.610586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 447/889] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:42.616088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.635640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.636606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.637076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.637536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.638963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:42.640536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:42.648445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:42.651581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:42.652535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:42.653978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:42.661443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 443/890] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:42.662585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.695111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:42.731535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15392e13-df14-4506-b7d4-091b631182cd None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.767187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.767816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.768095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.768365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.775108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8e180-f7a4-4625-aa39-f0bb742d2854 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.776324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:42.779113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:42.799113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:42.800113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:42.801027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:42.804772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 448/891] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:42.812153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.828786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.829403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.829685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.829957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.830587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:42.831247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:42.833070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:42.843982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 444/892] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:42.846812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:42.931318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:42.940933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252027c9-10a6-4850-aff3-5f7456eb60c5 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.955591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:42.972260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d861-5c87-433c-b7c5-ad5725d8a16d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:42.976666 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a98c-0d76-4a3c-9e48-e16ed99f2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:42.977491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a98c-0d76-4a3c-9e48-e16ed99f2c56 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:42.977982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a98c-0d76-4a3c-9e48-e16ed99f2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:42.978446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a98c-0d76-4a3c-9e48-e16ed99f2c56 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:42.979419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a98c-0d76-4a3c-9e48-e16ed99f2c56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:42.979916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a98c-0d76-4a3c-9e48-e16ed99f2c56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:42.981547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a98c-0d76-4a3c-9e48-e16ed99f2c56 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:42.999017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 449/893] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:43.000312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08217141-135e-4764-b3d4-edeb2a425150 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.000597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08217141-135e-4764-b3d4-edeb2a425150 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.000865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08217141-135e-4764-b3d4-edeb2a425150 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.002190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 450/894] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:43.007073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08217141-135e-4764-b3d4-edeb2a425150 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.015473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669c7c6-68ad-4a7f-bd32-1fab1b585998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.016521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669c7c6-68ad-4a7f-bd32-1fab1b585998 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.016805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669c7c6-68ad-4a7f-bd32-1fab1b585998 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.017081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669c7c6-68ad-4a7f-bd32-1fab1b585998 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.018078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669c7c6-68ad-4a7f-bd32-1fab1b585998 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:43.018447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669c7c6-68ad-4a7f-bd32-1fab1b585998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.020207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669c7c6-68ad-4a7f-bd32-1fab1b585998 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.026181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 445/895] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:43.027396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea804a3-599f-4453-896e-2edf8aba1d60 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.027683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea804a3-599f-4453-896e-2edf8aba1d60 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.027958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea804a3-599f-4453-896e-2edf8aba1d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.046783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0ea804a3-599f-4453-896e-2edf8aba1d60 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:43.047943 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0ea804a3-599f-4453-896e-2edf8aba1d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:43.114178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 446/896] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:43.118933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea804a3-599f-4453-896e-2edf8aba1d60 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.128608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08217141-135e-4764-b3d4-edeb2a425150 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.166837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.167692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.168119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.168616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.191076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.212124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.231725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea804a3-599f-4453-896e-2edf8aba1d60 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.250206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.251787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.268937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.269812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.270236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.270654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.271531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] RBAC: Adding query filter params (interface=public, service_id=10f6fcd73abf4e7d810e2c7a23c3d85c, region_id=RegionOne) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:43.272004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.273808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.279506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 447/897] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/endpoints?service_id=10f6fcd73abf4e7d810e2c7a23c3d85c&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:43.284726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.377068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 451/898] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:36:43.382743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.407521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61640c-992d-4dc6-8a97-959bb3548bc3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.434308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.449176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.449176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.449176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.449176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.449674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.449674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.452697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 448/899] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:36:43.453646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.473240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.493153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae3d8a-4d37-4de9-a752-cbc6b8f5697a None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.533426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.534075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.534348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.534691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.546931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.548419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:43.565163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:43.566175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:43.567097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:43.567097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:43.567097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:43.571067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 452/900] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:43.572041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.585115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b407a-5e25-4c3c-92b8-cfd51e8dda94 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.631790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecb7e8-897a-4885-a5ec-1656a097cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.632447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb7e8-897a-4885-a5ec-1656a097cd0e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.632725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb7e8-897a-4885-a5ec-1656a097cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.632994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecb7e8-897a-4885-a5ec-1656a097cd0e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.633597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecb7e8-897a-4885-a5ec-1656a097cd0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.635097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecb7e8-897a-4885-a5ec-1656a097cd0e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-b8ecb7e8-897a-4885-a5ec-1656a097cd0e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:43.645491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:43.646488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:43.647653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 449/901] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:43.648418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb230-36b9-4e10-bbe3-4ae4bfd367c1 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.649100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb230-36b9-4e10-bbe3-4ae4bfd367c1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.649100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb230-36b9-4e10-bbe3-4ae4bfd367c1 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.650393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 450/902] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:43.653033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb230-36b9-4e10-bbe3-4ae4bfd367c1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.698220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ebfbf-f977-46ea-8b3a-a3b0e9e7937d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.699897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.733274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576f5a4-b16e-4adf-8f9a-320827bd958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.733934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f5a4-b16e-4adf-8f9a-320827bd958f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.734213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f5a4-b16e-4adf-8f9a-320827bd958f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.734480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576f5a4-b16e-4adf-8f9a-320827bd958f None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.735172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576f5a4-b16e-4adf-8f9a-320827bd958f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:43.735473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576f5a4-b16e-4adf-8f9a-320827bd958f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.736839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576f5a4-b16e-4adf-8f9a-320827bd958f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.742192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.750065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 453/903] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:43.753578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8dab1-5c3c-4b25-9974-d60faf497a59 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.753578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8dab1-5c3c-4b25-9974-d60faf497a59 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.753578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8dab1-5c3c-4b25-9974-d60faf497a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.774302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-60c8dab1-5c3c-4b25-9974-d60faf497a59 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:43.774853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eb230-36b9-4e10-bbe3-4ae4bfd367c1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.775492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-60c8dab1-5c3c-4b25-9974-d60faf497a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:43.810439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.811068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.811346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.811613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.812236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:43.812541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.813900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.818822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 451/904] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:43.819535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.851405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 454/905] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:43.852517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8dab1-5c3c-4b25-9974-d60faf497a59 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:43.935305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d407f99-0f13-4d03-8e1e-d80be3217797 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.970728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:43.971638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:43.972488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:43.972994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:43.976348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.977797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:43.981152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:43.983115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:43.988887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8dab1-5c3c-4b25-9974-d60faf497a59 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:43.994611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:43.995502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:43.996397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:44.000711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 452/906] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:44.002005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.035436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.036383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.036750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.037395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.038292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:44.038595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.040667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.048267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 455/907] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:44.053557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.121021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb784ae-d4a7-42fa-94ff-2ac47457b201 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.158352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.158988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.159269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.159536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.160217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:44.160516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.161942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.164365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007343-fecb-4883-b9b7-32daca2aa9d3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.174503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 453/908] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:44.175612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.204132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.204855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.205142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.205528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.206347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] RBAC: Adding query filter params (interface=public, service_id=336fbb058410442c846e8afc7f34629d, region_id=RegionOne) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:44.206651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.208030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.218699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 456/909] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/endpoints?service_id=336fbb058410442c846e8afc7f34629d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:44.218699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.241182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:44.241618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:44.288888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d09c54-7d2e-4ae9-bd2e-94d8ec84484f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.324643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71b90-9f9e-4fd4-be07-8d71a041af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.325768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71b90-9f9e-4fd4-be07-8d71a041af20 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.326053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71b90-9f9e-4fd4-be07-8d71a041af20 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.326328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71b90-9f9e-4fd4-be07-8d71a041af20 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.327003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71b90-9f9e-4fd4-be07-8d71a041af20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.328391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71b90-9f9e-4fd4-be07-8d71a041af20 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.329234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5893b-1b95-4cb8-93ab-7fd5c8198786 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.363328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.363922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.364197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.364462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.365179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] RBAC: Adding query filter params (role.id=b0228ec93bda4d5f87d6bfb26aa20af2, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=3c1c66c9a43b41e89551ad02466a691e) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:44.365570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.367003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.372339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 457/910] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/role_assignments?user.id=3c1c66c9a43b41e89551ad02466a691e&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=b0228ec93bda4d5f87d6bfb26aa20af2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:44.373124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:44.411176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 454/911] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:44 2022] POST /identity/v3/services => generated 241 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:44.492487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:44.511164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecddb9-ef5d-4ff3-a60d-a8174af59c18 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:44.562141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc0ac-5f37-48d1-b564-fb60a2895df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:44.562872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc0ac-5f37-48d1-b564-fb60a2895df9 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:44.563588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc0ac-5f37-48d1-b564-fb60a2895df9 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:44.563869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc0ac-5f37-48d1-b564-fb60a2895df9 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:44.564523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc0ac-5f37-48d1-b564-fb60a2895df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:44.567043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc0ac-5f37-48d1-b564-fb60a2895df9 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:44.574338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 458/912] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:44 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:36:45.682827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc196458-0e4b-446f-a6cf-1158d102f265 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:45.683375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc196458-0e4b-446f-a6cf-1158d102f265 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:45.683375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc196458-0e4b-446f-a6cf-1158d102f265 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:45.685102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 455/913] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:45.690774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9508-33ad-4025-acf9-181743310d68 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:45.691245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9508-33ad-4025-acf9-181743310d68 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:45.691347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef9508-33ad-4025-acf9-181743310d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:45.710019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-dcef9508-33ad-4025-acf9-181743310d68 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:45.711215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dcef9508-33ad-4025-acf9-181743310d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:45.782789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 459/914] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:46.045700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc196458-0e4b-446f-a6cf-1158d102f265 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:46.154281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc196458-0e4b-446f-a6cf-1158d102f265 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:46.171743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:46.190556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:46.194398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.194398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.194398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.194398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:46.194398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:46.204494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:46.205784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 09:36:46.206925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:46.209370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 456/915] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:46.215158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9508-33ad-4025-acf9-181743310d68 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:46.297764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:46.323486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef9508-33ad-4025-acf9-181743310d68 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:46.359329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:46.360345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.360804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.361234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.362017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:46.362473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:46.364006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:46.369484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 460/916] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:46.375822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:46.479507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e426887-745e-4427-a171-5e929e8ce7ab None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:46.515663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdf5f7-c9a0-4545-9bd4-e520e60535f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:46.516273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdf5f7-c9a0-4545-9bd4-e520e60535f0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.516547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdf5f7-c9a0-4545-9bd4-e520e60535f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.516816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdf5f7-c9a0-4545-9bd4-e520e60535f0 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.517501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdf5f7-c9a0-4545-9bd4-e520e60535f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:46.517864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdf5f7-c9a0-4545-9bd4-e520e60535f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:46.519315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdf5f7-c9a0-4545-9bd4-e520e60535f0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:46.529749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 457/917] 10.222.0.49 () {56 vars in 1114 bytes} [Fri Oct 28 09:36:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:46.531304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:46.641055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94bc5-b7e2-4734-9547-90e57f89f4ca None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:46.669375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb309-1d6f-4a22-a7da-5bea28c61047 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.669657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb309-1d6f-4a22-a7da-5bea28c61047 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.669930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb309-1d6f-4a22-a7da-5bea28c61047 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.671563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 458/918] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:46.680613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e79250-63fb-4af5-888e-f9321a8a7cef None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.680957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e79250-63fb-4af5-888e-f9321a8a7cef None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.681187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e79250-63fb-4af5-888e-f9321a8a7cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.689197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aa875-5bbe-4d28-af56-fbb71fc043d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:46.689833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa875-5bbe-4d28-af56-fbb71fc043d8 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.690109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa875-5bbe-4d28-af56-fbb71fc043d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.690378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aa875-5bbe-4d28-af56-fbb71fc043d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.691565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aa875-5bbe-4d28-af56-fbb71fc043d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:46.692537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aa875-5bbe-4d28-af56-fbb71fc043d8 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:46.702025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:46.703358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-35e79250-63fb-4af5-888e-f9321a8a7cef None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:46.704631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-35e79250-63fb-4af5-888e-f9321a8a7cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:46.744727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:46.770122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 459/919] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:46.771463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db672-63e4-41f4-be6f-80d9eef20d2b None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.771750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db672-63e4-41f4-be6f-80d9eef20d2b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.772275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738db672-63e4-41f4-be6f-80d9eef20d2b None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.773634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 460/920] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:46.779422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344992-b37d-427b-af2e-e900c6ed8d79 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.779702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344992-b37d-427b-af2e-e900c6ed8d79 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.779970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344992-b37d-427b-af2e-e900c6ed8d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.798081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-09344992-b37d-427b-af2e-e900c6ed8d79 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:46.799361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-09344992-b37d-427b-af2e-e900c6ed8d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:46.810607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 461/921] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:46.813653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d695cc2-94f7-4c56-bfe7-742409db484c None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.813653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d695cc2-94f7-4c56-bfe7-742409db484c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.813653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d695cc2-94f7-4c56-bfe7-742409db484c None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.813924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 462/922] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:46.820494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a343200-e81c-44b0-a7d5-1fd46bfeeb6c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:46.820819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a343200-e81c-44b0-a7d5-1fd46bfeeb6c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:46.821188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a343200-e81c-44b0-a7d5-1fd46bfeeb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:46.853512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9a343200-e81c-44b0-a7d5-1fd46bfeeb6c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:46.856038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9a343200-e81c-44b0-a7d5-1fd46bfeeb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:46.898387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 461/923] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:46.944313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 463/924] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:47.042224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344992-b37d-427b-af2e-e900c6ed8d79 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.144624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:47.148002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344992-b37d-427b-af2e-e900c6ed8d79 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.186112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a343200-e81c-44b0-a7d5-1fd46bfeeb6c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.187440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.188302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.188886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.189346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.190214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.191790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:47.202311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:47.203355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:47.204188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:47.206795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 462/925] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:47.214792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.296339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a343200-e81c-44b0-a7d5-1fd46bfeeb6c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.318535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e152fe-4197-467f-b45a-de223a307ade None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.323465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:47.336316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.337108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.337505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.337941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.350429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:47.354327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030640f-eceb-4199-a016-60091977a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.354968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030640f-eceb-4199-a016-60091977a334 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:47.355244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:47.356273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:47.357155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:47.357826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030640f-eceb-4199-a016-60091977a334 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.357826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030640f-eceb-4199-a016-60091977a334 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.357826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030640f-eceb-4199-a016-60091977a334 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:47.358026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 464/926] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:47.358026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.361355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030640f-eceb-4199-a016-60091977a334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.363000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030640f-eceb-4199-a016-60091977a334 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.368386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 463/927] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:47.369267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030640f-eceb-4199-a016-60091977a334 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.400305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:47.464518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0761b-7e03-4d3a-b5b3-940ce60c741d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.474296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030640f-eceb-4199-a016-60091977a334 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.501546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.502156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.502426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.502720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.503306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.504837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.509031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.509735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.510114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.510487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.511312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:47.511717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.513683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:47.514249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:47.515356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:47.519698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 465/928] 10.222.0.49 () {56 vars in 1132 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:47.520502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.528009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 464/929] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:47.529511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.578279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:47.626017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:47.632849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386e58-353f-449d-85f9-f6524fb0a01f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.635294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd7d41-de73-4096-88c0-ebce44b98730 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.670939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.671432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.671553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.671823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.672070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.672168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.672347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.672610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.672710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:47.672985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.673223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:47.673519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.674377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.674892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.681121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 465/930] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:47.681121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.688747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 466/931] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:47.689692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.790105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07143bd7-9862-40d3-a10d-5a5ebd024185 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.806629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4b6d-650f-4613-a5ae-873097f7c2aa None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.819986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:47.826466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.827124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.827406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.827675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.838888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.840872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.845570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.846175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.846501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.846754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:47.847789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:47.848098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:47.849859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:47.860479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 467/932] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:47.860627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:47.861545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:47.862459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:47.862459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:47.862459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:47.862648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.862764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 466/933] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:47.862764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:47.872644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:47.966209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231e5e6-615c-4dea-a9b5-af478f442b83 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.966846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8f7be-53fc-4d1d-9366-a87a85b65839 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:47.998782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:47.999389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:47.999665 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:47.999936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.000603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.001968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.004465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.005262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.005693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.006111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.007161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] RBAC: Adding query filter params (interface=public, service_id=d38de4f1d2bc443fa937d60da9b2c48d, region_id=RegionOne) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:48.007629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.009097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.015275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 468/934] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:47 2022] GET /identity/v3/endpoints?service_id=d38de4f1d2bc443fa937d60da9b2c48d&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:48.016048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.058058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:48.114596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f95b5-4e30-4823-9c67-24e15472e019 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.115238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 467/935] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:48.116558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.165826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.166479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.166792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.167072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.167733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:48.168043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.169492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.188088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 469/936] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:48.193118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.220142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:48.267781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8168274-6968-4484-9eb3-0e8f09cd948f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.306930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.308022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.308512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.308934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.310217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.311637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.319387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 468/937] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:36:48.322267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:48.328887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9204e-ae74-4bb2-a8b7-4bad74392abd None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.371379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.372591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.372867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.373133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.381821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.383408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:48.397857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:48.399045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:48.399993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 470/938] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:48.404990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.520236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4085533-03fd-4ecb-b54e-4a7d12e48efa None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.546758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:48.555665 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.571293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.571293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.571293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.571293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:48.571293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.571293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.579310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 469/939] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:48.584626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.691803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa2a4e-39a3-4399-972a-63588392f1bb None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.726838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.727549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.727887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.728219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.739625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.741186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:48.756415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:48.757578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:48.758693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:48.758693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:48.758693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:48.759352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 471/940] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:48.764796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.869656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c330648-114b-41f0-90a9-44eb6978c2b1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:48.905083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48483098-5d7a-42df-a3b4-c9394930db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:48.905740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483098-5d7a-42df-a3b4-c9394930db96 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:48.906025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483098-5d7a-42df-a3b4-c9394930db96 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:48.906290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483098-5d7a-42df-a3b4-c9394930db96 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:48.906961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48483098-5d7a-42df-a3b4-c9394930db96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:48.907257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48483098-5d7a-42df-a3b4-c9394930db96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:48.908627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48483098-5d7a-42df-a3b4-c9394930db96 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:48.921107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 470/941] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:48.926405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:48.938809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:49.037824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac965a-e00a-4c8f-94f5-1d616ed48519 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:49.074008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:49.075120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:49.075657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:49.076361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:49.083683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:49.085399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:49.089370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774013c2-0f66-46e4-b65f-a538d23fda4f None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:49.089719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774013c2-0f66-46e4-b65f-a538d23fda4f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:49.089995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774013c2-0f66-46e4-b65f-a538d23fda4f None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:49.094806 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 471/942] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:49.097312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d26fd-10a8-4e99-9f07-9be4df305ac3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:49.097595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d26fd-10a8-4e99-9f07-9be4df305ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:49.097870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d26fd-10a8-4e99-9f07-9be4df305ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:49.100219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:49.101089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:49.101983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.104067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 472/943] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:49.111913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:49.117733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f30d26fd-10a8-4e99-9f07-9be4df305ac3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:49.119051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f30d26fd-10a8-4e99-9f07-9be4df305ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:49.175281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:49.192433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:49.204414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 472/944] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:49.232397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53c16d-0896-4648-b1c2-9c7692d55161 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:49.266403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:49.267151 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:49.267375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:49.267610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:49.268691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:49.269352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:49.270818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:49.285421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 473/945] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:49.291580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d26fd-10a8-4e99-9f07-9be4df305ac3 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:49.399461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d26fd-10a8-4e99-9f07-9be4df305ac3 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:49.434018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:49.434609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:49.434916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:49.435188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/3c1c66c9a43b41e89551ad02466a691e/roles/b0228ec93bda4d5f87d6bfb26aa20af2` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:49.437348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=3c1c66c9a43b41e89551ad02466a691e, role_id=b0228ec93bda4d5f87d6bfb26aa20af2)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:49.439383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:49.475729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:49.518372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 473/946] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:36:49 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/3c1c66c9a43b41e89551ad02466a691e/roles/b0228ec93bda4d5f87d6bfb26aa20af2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:36:49.598498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e91df-c8dd-4b2a-a194-78e7b7ac4c8e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:49.631537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:49.641401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:49.642028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:49.647496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:49.647496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:49.647496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:49.647496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:49.648275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING keystone.server.flask.common [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 09:36:49.704691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.sql.core [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:36:49.704691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 09:36:49.704691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [parameters: {'id': 'd3b20b184c0643c38f59fbf2f98d8d97', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 09:36:49.704691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88565) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3b20b184c0643c38f59fbf2f98d8d97.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3b20b184c0643c38f59fbf2f98d8d97. Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:36:49.712217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result.read() Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 09:36:49.713024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application yield resource Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise self.value Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application session.commit() Oct 28 09:36:49.713973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:36:49.715004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:36:49.717911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application result.read() Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:36:49.719834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [parameters: {'id': 'd3b20b184c0643c38f59fbf2f98d8d97', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:49.721942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:49.723943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3b20b184c0643c38f59fbf2f98d8d97. Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:49.726915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 474/947] 10.222.0.49 () {60 vars in 1140 bytes} [Fri Oct 28 09:36:49 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:49.728177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:49.758153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:49.828735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41034332-091f-4ad6-b89a-0673ad6f0486 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:49.864189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6b053-b0eb-461e-bda2-cf87021e61b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:49.865202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6b053-b0eb-461e-bda2-cf87021e61b6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:49.865704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6b053-b0eb-461e-bda2-cf87021e61b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:49.866170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6b053-b0eb-461e-bda2-cf87021e61b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:49.874094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6b053-b0eb-461e-bda2-cf87021e61b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:49.876383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6b053-b0eb-461e-bda2-cf87021e61b6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c9c6b053-b0eb-461e-bda2-cf87021e61b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:49.889069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:49.889967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:49.890902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:49.893225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 474/948] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:49.899522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:50.001697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac1e10-7c33-477f-9d68-19a5c667d580 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:50.037685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38eb79-5247-4796-8861-aadf94a02e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:50.038344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38eb79-5247-4796-8861-aadf94a02e6d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:50.038623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38eb79-5247-4796-8861-aadf94a02e6d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:50.038921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38eb79-5247-4796-8861-aadf94a02e6d None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:50.039621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38eb79-5247-4796-8861-aadf94a02e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:50.039980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38eb79-5247-4796-8861-aadf94a02e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:50.041615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38eb79-5247-4796-8861-aadf94a02e6d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:50.066831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 475/949] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:50.514364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b407ed-a167-4873-a86d-68f7bdc5f6cc None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:50.515126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b407ed-a167-4873-a86d-68f7bdc5f6cc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:50.515629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b407ed-a167-4873-a86d-68f7bdc5f6cc None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:50.517521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 475/950] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:50.523716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47506797-673f-42b2-aec6-1dcaa89ca2f5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:50.524004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47506797-673f-42b2-aec6-1dcaa89ca2f5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:50.524279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47506797-673f-42b2-aec6-1dcaa89ca2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:50.544104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-47506797-673f-42b2-aec6-1dcaa89ca2f5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:50.545648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-47506797-673f-42b2-aec6-1dcaa89ca2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:50.587074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:50.610087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36341c-332d-4f1a-8e66-42602e37a96c None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:50.615290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36341c-332d-4f1a-8e66-42602e37a96c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:50.615290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36341c-332d-4f1a-8e66-42602e37a96c None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:50.615290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 476/951] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:50.616950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc294-cf96-4222-b938-3c7c0b541327 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:50.617272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc294-cf96-4222-b938-3c7c0b541327 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:50.617401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc294-cf96-4222-b938-3c7c0b541327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:50.617576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 476/952] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:50.637753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-68dfc294-cf96-4222-b938-3c7c0b541327 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:50.638936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-68dfc294-cf96-4222-b938-3c7c0b541327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:50.716333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 477/953] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:50.884261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47506797-673f-42b2-aec6-1dcaa89ca2f5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:50.984925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47506797-673f-42b2-aec6-1dcaa89ca2f5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:50.986558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc294-cf96-4222-b938-3c7c0b541327 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.016579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.035357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.036352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.036632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.036902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.037801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.039476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:51.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:51.053373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:51.054478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 477/954] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:51.062029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.104710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc294-cf96-4222-b938-3c7c0b541327 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.107029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.145836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.147070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.147562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.148026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.148847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.150406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:51.160494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:51.161543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:51.162407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:51.170366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 478/955] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:51.171517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.180020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30772f19-709b-4baa-ac07-f5b159a3fa19 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.215776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.216812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.217351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.217816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.218883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:51.220285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.221853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.228220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 478/956] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:51.234987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.288288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.301761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67731-b417-4aaa-8ae0-b61fdaa805fc None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.370604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.371776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.372854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.373878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.378179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:51.378720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.385992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.393403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1d81-ae9e-401d-843b-64a8f5302760 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.399868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 479/957] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:51.409722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.423145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.453811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.454442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.454711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.454988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.455613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] RBAC: Adding query filter params (type=compute) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:51.455912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.457280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.474851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 479/958] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:51.556294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9193573-4a9f-4741-bd8c-bd0552190a39 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.607926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f5096-7e26-4c95-af15-1391ecd30dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.608519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f5096-7e26-4c95-af15-1391ecd30dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.608792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f5096-7e26-4c95-af15-1391ecd30dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.609055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f5096-7e26-4c95-af15-1391ecd30dc9 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.609690 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f5096-7e26-4c95-af15-1391ecd30dc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:51.609987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f5096-7e26-4c95-af15-1391ecd30dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.615608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f5096-7e26-4c95-af15-1391ecd30dc9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.629890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 480/959] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:51.638691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:51.784800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f74ec-cfa5-464c-a2e4-562ca83e2bed None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:51.815205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a46b-05f3-4cda-97ae-436995fc87bd None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.815511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a46b-05f3-4cda-97ae-436995fc87bd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.815731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8a46b-05f3-4cda-97ae-436995fc87bd None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.817286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 481/960] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:51.822774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bf74e-5c8b-4ab4-a75c-f7ff6064f117 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.823070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bf74e-5c8b-4ab4-a75c-f7ff6064f117 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.823340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bf74e-5c8b-4ab4-a75c-f7ff6064f117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.834381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:51.835696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:51.837538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:51.837885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:51.839036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:51.841553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:51.844219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-487bf74e-5c8b-4ab4-a75c-f7ff6064f117 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:51.845731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-487bf74e-5c8b-4ab4-a75c-f7ff6064f117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:51.861646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:51.926855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 482/961] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:51.931167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 480/962] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:52.208449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bf74e-5c8b-4ab4-a75c-f7ff6064f117 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:52.313255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bf74e-5c8b-4ab4-a75c-f7ff6064f117 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:52.354816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c808b2-459d-428d-b3fa-2976c6160251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:52.355467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c808b2-459d-428d-b3fa-2976c6160251 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.355788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c808b2-459d-428d-b3fa-2976c6160251 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.356055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c808b2-459d-428d-b3fa-2976c6160251 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.368748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c808b2-459d-428d-b3fa-2976c6160251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-60c808b2-459d-428d-b3fa-2976c6160251 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:36:52.374364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:52.375411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:36:52.376249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:52.380728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 483/963] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 09:36:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:52.382194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:52.409015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:52.480267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc61b-e1d9-45cc-b5c8-4c847cc809ff None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.480444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc61b-e1d9-45cc-b5c8-4c847cc809ff None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.481757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfc61b-e1d9-45cc-b5c8-4c847cc809ff None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.483414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 484/964] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:36:52.488505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948752d4-f2dd-42a2-b63c-3823f1a825bd None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.488781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948752d4-f2dd-42a2-b63c-3823f1a825bd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.489047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948752d4-f2dd-42a2-b63c-3823f1a825bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.493922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561defa-5d75-4a8d-b2a2-57af87fd2136 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:52.498644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:52.509399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-948752d4-f2dd-42a2-b63c-3823f1a825bd None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:52.510636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-948752d4-f2dd-42a2-b63c-3823f1a825bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:52.529919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:52.530552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.530860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.531127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.531784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:52.532082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:52.533440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:52.542251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 481/965] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 09:36:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:52.551503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:52.593034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 485/966] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:52.654211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:52.664707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80548e9a-c487-419c-ade1-4efcdeaf18d1 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:52.699461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:52.700096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.700376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.700651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.712115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:52.713570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:52.728433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:52.729398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:52.731322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:52.731322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:52.731322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:52.731322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 482/967] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:52.736752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948752d4-f2dd-42a2-b63c-3823f1a825bd None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:52.840503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948752d4-f2dd-42a2-b63c-3823f1a825bd None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:52.871319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:52.876544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:52.877176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:52.877508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:52.877785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:52.878571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:52.878909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:52.880435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:52.893367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 486/968] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:52.899205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:52.919667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:53.007201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765d24-12dd-4688-8057-1588c2883d2e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:53.041882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:53.042500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.042817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.043084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.046976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:53.052131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:53.053638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:53.057433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249fb08-a5ab-4ec6-8ab7-9c9fe0698338 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:53.064649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:53.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 09:36:53.066622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:53.070548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 483/969] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:36:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:53.071613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:53.106286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:53.107149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.107646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.108317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.110066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:53.111694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:53.115164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING keystone.server.flask.common [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 09:36:53.161929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.sql.core [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:36:53.161929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 09:36:53.161929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [parameters: {'user_id': 'fb3f2e0bcc904180be081d268d76e478', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 09:36:53.161929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88564) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 09:36:53.176188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ca17-26e1-4d3b-834a-68396a2ee503 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application result.read() Oct 28 09:36:53.184697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:36:53.185618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application yield resource Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application next(self.gen) Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise self.value Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application session.commit() Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 09:36:53.186559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self.session.flush() Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application compat.raise_( Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:36:53.187705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:36:53.188615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application conn.query(q) Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application result.read() Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:36:53.189564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fb3f2e0bcc904180be081d268d76e478', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:53.190580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 28 09:36:53.191545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 487/970] 10.222.0.49 () {60 vars in 1131 bytes} [Fri Oct 28 09:36:52 2022] POST /identity/v3/users => generated 160 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:53.192504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:53.226474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:53.227585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.228027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.228433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.229311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:53.229824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:53.232024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:53.253006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 484/971] 10.222.0.49 () {56 vars in 1149 bytes} [Fri Oct 28 09:36:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:53.258205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:53.270517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:53.310543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117f6a-a129-4539-8814-7d4b6e3a36b3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:53.331822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:53.352024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:53.353550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.354036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.354527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.365251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:53.367893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:53.375310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a72ae-e2b4-4d9f-9a4b-a55fb5f00214 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:36:53.383648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:53.384587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 09:36:53.385528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:53.387794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 488/972] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:36:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:53.394283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:53.427017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a26f7-f840-4045-a35d-dd53249bae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:53.427707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a26f7-f840-4045-a35d-dd53249bae65 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.427918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a26f7-f840-4045-a35d-dd53249bae65 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.428237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a26f7-f840-4045-a35d-dd53249bae65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.502534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cc0e0-6b6d-477c-bc70-6dea3917daa9 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:53.517334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:53.522612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a26f7-f840-4045-a35d-dd53249bae65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:53.524222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a26f7-f840-4045-a35d-dd53249bae65 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:53.539197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:53.540108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.540628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.541092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.542003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:53.542495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:53.544862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:53.591111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 489/973] 10.222.0.49 () {56 vars in 1101 bytes} [Fri Oct 28 09:36:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:53.592029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:53.645435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 485/974] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:36:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:36:53.651642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:53.776583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305eedda-aeef-4cd1-a805-57adc26f8f94 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:53.803314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5b19-e1eb-4469-be00-be33509fe666 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.803593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5b19-e1eb-4469-be00-be33509fe666 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.803862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff5b19-e1eb-4469-be00-be33509fe666 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.805196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 486/975] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:53.810989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750c07-ccd3-4793-a496-eaecce02a7e6 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.811443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750c07-ccd3-4793-a496-eaecce02a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.811758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750c07-ccd3-4793-a496-eaecce02a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.819968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:53.820608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:53.820865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:53.821129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:53.835198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-74750c07-ccd3-4793-a496-eaecce02a7e6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:53.836390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-74750c07-ccd3-4793-a496-eaecce02a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:53.837231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:53.839176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:36:53.860471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:53.861628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:36:53.863223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:36:53.863223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:36:53.863223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:53.864789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 490/976] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:53.872390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:53.906309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:53.923029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 487/977] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:36:53.984207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278c121-0ee5-44ba-9a41-b362142c2f0d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.017443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.018041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.018312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.018573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.019246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:54.019540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.020945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.036686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 491/978] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:54.038021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750c07-ccd3-4793-a496-eaecce02a7e6 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.126951 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.142424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750c07-ccd3-4793-a496-eaecce02a7e6 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.176883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab14ef-6ea7-40ff-9000-a997e81eb133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.177556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab14ef-6ea7-40ff-9000-a997e81eb133 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.177830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab14ef-6ea7-40ff-9000-a997e81eb133 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.178092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab14ef-6ea7-40ff-9000-a997e81eb133 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.185462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab14ef-6ea7-40ff-9000-a997e81eb133 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.186920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab14ef-6ea7-40ff-9000-a997e81eb133 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.188877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-06ab14ef-6ea7-40ff-9000-a997e81eb133 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:36:54.198528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:54.199489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:54.200430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 488/979] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:54.200931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7431b-60e7-4929-8753-1eec9b7f593b None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.201213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7431b-60e7-4929-8753-1eec9b7f593b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.201482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7431b-60e7-4929-8753-1eec9b7f593b None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.202725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 489/980] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:54.205389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7431b-60e7-4929-8753-1eec9b7f593b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.274364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.290481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99874863-df38-4e9b-bb88-dc832b5abb36 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.306175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7431b-60e7-4929-8753-1eec9b7f593b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.325222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.325898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.326182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.326454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.327131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.328503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.338560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a5dd8-9c4d-45c2-9d2c-5826190a5dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.339182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a5dd8-9c4d-45c2-9d2c-5826190a5dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.339459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a5dd8-9c4d-45c2-9d2c-5826190a5dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.339729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a5dd8-9c4d-45c2-9d2c-5826190a5dd8 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.340974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a5dd8-9c4d-45c2-9d2c-5826190a5dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:54.341273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a5dd8-9c4d-45c2-9d2c-5826190a5dd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.342661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a5dd8-9c4d-45c2-9d2c-5826190a5dd8 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.353918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 490/981] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:54.355072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f425a05-4ecd-4e0d-a916-398f827a71fa None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.355356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f425a05-4ecd-4e0d-a916-398f827a71fa None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.356167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f425a05-4ecd-4e0d-a916-398f827a71fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.362816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.373179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0f425a05-4ecd-4e0d-a916-398f827a71fa None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:54.375627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0f425a05-4ecd-4e0d-a916-398f827a71fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:54.400695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 492/982] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:36:54 2022] POST /identity/v3/services => generated 242 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:36:54.401432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.461041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 491/983] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:54.520536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe471af-4917-4948-a93e-05cc95da38b4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.559100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.559716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.559989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.560258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.560983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] RBAC: Adding query filter params (role.id=b0228ec93bda4d5f87d6bfb26aa20af2, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=3c1c66c9a43b41e89551ad02466a691e) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:54.561282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.562728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.575006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 493/984] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:36:54 2022] GET /identity/v3/role_assignments?user.id=3c1c66c9a43b41e89551ad02466a691e&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=b0228ec93bda4d5f87d6bfb26aa20af2 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:54.730685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f425a05-4ecd-4e0d-a916-398f827a71fa None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.836115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f425a05-4ecd-4e0d-a916-398f827a71fa None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:54.865073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.871121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:54.871763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:54.872034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:54.872299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:54.872879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:54.874242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:54.882957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:54.884011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:36:54.885165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 492/985] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:54.890566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:54.905727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:54.995835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2192d-77b7-44a5-b23f-904748476b99 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:55.028877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:55.029531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:55.029819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:55.030088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:55.030729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:55.031031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:55.032391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:55.041821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 494/986] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:55.043026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:55.144042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fbf2a-8252-4cbe-aece-cb2bb7e436f4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:55.177018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:55.177615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:55.177926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:55.178163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:55.178798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:55.179097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:55.180473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:55.186010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 493/987] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:55.191656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:55.260333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:55.291205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97851682-623d-4ec7-b176-36966a243ec8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:55.327317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4020b7-a912-4ced-a9bd-a54a5799c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:55.328011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4020b7-a912-4ced-a9bd-a54a5799c960 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:55.328288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4020b7-a912-4ced-a9bd-a54a5799c960 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:55.328551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4020b7-a912-4ced-a9bd-a54a5799c960 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:55.329236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4020b7-a912-4ced-a9bd-a54a5799c960 None admin] RBAC: Adding query filter params (interface=admin, service_id=d38de4f1d2bc443fa937d60da9b2c48d, region_id=RegionOne) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:55.329541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4020b7-a912-4ced-a9bd-a54a5799c960 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:55.330956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4020b7-a912-4ced-a9bd-a54a5799c960 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:55.340467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 495/988] 10.222.0.49 () {56 vars in 1249 bytes} [Fri Oct 28 09:36:55 2022] GET /identity/v3/endpoints?service_id=d38de4f1d2bc443fa937d60da9b2c48d&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:55.342054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:55.399440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:55.440943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31c09-ef18-4d69-a7c9-879701ab0d91 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:55.473408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b059a37-656a-4235-bae2-7a8ddc6f4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:55.474033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059a37-656a-4235-bae2-7a8ddc6f4a67 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:55.474259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059a37-656a-4235-bae2-7a8ddc6f4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:55.474524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b059a37-656a-4235-bae2-7a8ddc6f4a67 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:55.475143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b059a37-656a-4235-bae2-7a8ddc6f4a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:55.476500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b059a37-656a-4235-bae2-7a8ddc6f4a67 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:55.491056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 494/989] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:55 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:36:56.580077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851c95-634f-4c64-873f-189e2ec9b02a None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:56.580635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851c95-634f-4c64-873f-189e2ec9b02a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:56.580635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851c95-634f-4c64-873f-189e2ec9b02a None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:56.582713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 496/990] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:56.587435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6726-db7a-4176-a631-fec3513fb8ad None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:56.587839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6726-db7a-4176-a631-fec3513fb8ad None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:56.588006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6726-db7a-4176-a631-fec3513fb8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:56.606278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-135f6726-db7a-4176-a631-fec3513fb8ad None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:56.607503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-135f6726-db7a-4176-a631-fec3513fb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:56.680984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 495/991] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:56.765032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd872-a220-4c4b-a5bd-fe9abae64a53 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:56.765367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd872-a220-4c4b-a5bd-fe9abae64a53 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:56.765577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd872-a220-4c4b-a5bd-fe9abae64a53 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:56.767091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 497/992] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:56.772309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f923dd-4bad-415c-b9d2-45dfd62b9f46 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:56.772598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f923dd-4bad-415c-b9d2-45dfd62b9f46 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:56.772868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f923dd-4bad-415c-b9d2-45dfd62b9f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:56.790819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d6f923dd-4bad-415c-b9d2-45dfd62b9f46 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:56.791988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d6f923dd-4bad-415c-b9d2-45dfd62b9f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:56.838559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:56.857701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 496/993] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:56.951386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd872-a220-4c4b-a5bd-fe9abae64a53 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.054309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd872-a220-4c4b-a5bd-fe9abae64a53 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.087765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.088391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.088722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.088931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.089513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.090942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.093558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:57.100561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:57.107223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:57.108133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 498/994] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:36:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:57.108936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f923dd-4bad-415c-b9d2-45dfd62b9f46 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.125062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.221863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f923dd-4bad-415c-b9d2-45dfd62b9f46 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.239065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6849e6-6c90-4896-9fc3-ac2f3fa2f2ac None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.260402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.261012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.261288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.261618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.262353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:57.262802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.264158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.274258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 497/995] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:57.274400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.274400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.274594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.274858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] PATH_INFO: `/v3/services/image` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.275285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.275399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.276658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:57.285960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:57.287018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:57.287870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 499/996] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:36:57.293426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.328813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:57.354519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:57.386764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f39498-5bc2-4cdb-abb5-2c8f3a5110eb None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.393311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c0164-1df2-42f4-af76-112f91d56247 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.425521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.426538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.427050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.427572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.427912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.428517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.428680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:57.428785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.429045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.429382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.429689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] RBAC: Adding query filter params (name=image) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:57.429987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.431284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.431401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.436630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 500/997] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:36:57.436991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 498/998] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:57.442405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.442655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.547622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee597f-1787-4a08-b30d-8a25c1a1923e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.557092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920deac-ae24-4df4-b08a-8c68985a6842 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.569791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:57.573226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:57.581010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91a150-a980-47bd-a552-cd7eb6626967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.581812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91a150-a980-47bd-a552-cd7eb6626967 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.582088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91a150-a980-47bd-a552-cd7eb6626967 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.582359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91a150-a980-47bd-a552-cd7eb6626967 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.583026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91a150-a980-47bd-a552-cd7eb6626967 None admin] RBAC: Adding query filter params (type=image) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:57.583324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91a150-a980-47bd-a552-cd7eb6626967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.584690 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91a150-a980-47bd-a552-cd7eb6626967 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.589203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 501/999] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:57.597462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.598996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.599460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.599921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.600827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] RBAC: Adding query filter params (interface=public, service_id=310cf2782fce487493d45af8077599f9, region_id=RegionOne) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:57.601337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.602958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.622715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 499/1000] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/endpoints?service_id=310cf2782fce487493d45af8077599f9&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:57.622904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da02a2-85c9-4578-b11b-2481401cfb70 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.622904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da02a2-85c9-4578-b11b-2481401cfb70 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.622904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da02a2-85c9-4578-b11b-2481401cfb70 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.622904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 502/1001] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:57.623184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:57.623256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdecd2a-88d4-45f2-b723-d0fc049bc15c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.623256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdecd2a-88d4-45f2-b723-d0fc049bc15c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.623256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdecd2a-88d4-45f2-b723-d0fc049bc15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.641430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cfdecd2a-88d4-45f2-b723-d0fc049bc15c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:57.642997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cfdecd2a-88d4-45f2-b723-d0fc049bc15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:57.722158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 503/1002] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:57.742538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9aee4-eb52-426f-8853-55e9f32f7825 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:57.782864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:57.783467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:57.783743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:57.784011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:57.784607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:57.785961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:57.793269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 500/1003] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:36:57.987726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdecd2a-88d4-45f2-b723-d0fc049bc15c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:58.088994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdecd2a-88d4-45f2-b723-d0fc049bc15c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:58.111872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:58.124132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:58.124768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:58.125046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:58.125314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:58.125898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:58.129730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:36:58.136250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:36:58.137773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:36:58.138608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 504/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Fri Oct 28 09:36:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:36:58.144595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:58.185382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:58.244957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca541f80-3357-4b24-a6bf-b56c46a71613 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:58.280895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:58.280895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:58.280895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:58.280895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:58.281311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:58.281569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:58.282956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:58.288076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 501/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:58.293636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:58.394153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71851f96-6a8d-4849-b900-662ffebd8744 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:58.427856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a7b93-0fea-4640-8870-0bdeeda409a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:58.428521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7b93-0fea-4640-8870-0bdeeda409a2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:58.428801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7b93-0fea-4640-8870-0bdeeda409a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:58.429093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a7b93-0fea-4640-8870-0bdeeda409a2 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:58.429722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7b93-0fea-4640-8870-0bdeeda409a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:36:58.430024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7b93-0fea-4640-8870-0bdeeda409a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:58.431414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a7b93-0fea-4640-8870-0bdeeda409a2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:58.441751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 505/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Fri Oct 28 09:36:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:36:58.442957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:36:58.545767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff0bda-c7dc-40a0-9c2a-5fb81b99b9b8 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:36:58.547310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:36:58.580268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9d00f-209f-4c7e-9cdf-9615092a38bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:36:58.580862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9d00f-209f-4c7e-9cdf-9615092a38bb None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:58.581137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9d00f-209f-4c7e-9cdf-9615092a38bb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:58.581404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9d00f-209f-4c7e-9cdf-9615092a38bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:58.582056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9d00f-209f-4c7e-9cdf-9615092a38bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:36:58.583428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9d00f-209f-4c7e-9cdf-9615092a38bb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:36:58.656070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 502/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:36:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:36:59.770605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d8924-1232-432b-9198-f20aeace601d None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:59.771405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d8924-1232-432b-9198-f20aeace601d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:59.771405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d8924-1232-432b-9198-f20aeace601d None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:59.772911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 506/1008] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:59.777943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588561-69a6-4c81-8ef4-1f9a365f2422 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:59.778341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588561-69a6-4c81-8ef4-1f9a365f2422 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:59.778501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e588561-69a6-4c81-8ef4-1f9a365f2422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:59.796517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0e588561-69a6-4c81-8ef4-1f9a365f2422 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:59.797683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0e588561-69a6-4c81-8ef4-1f9a365f2422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:36:59.878752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 503/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:36:59.944600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509a38b-1a4a-452c-90ed-433dd1012f2f None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:59.944895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509a38b-1a4a-452c-90ed-433dd1012f2f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:59.945079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509a38b-1a4a-452c-90ed-433dd1012f2f None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:59.946530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 507/1010] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:36:59.951714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6237c-07c2-4c71-9c45-d9393e9ae584 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:36:59.952000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6237c-07c2-4c71-9c45-d9393e9ae584 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:36:59.952272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6237c-07c2-4c71-9c45-d9393e9ae584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:36:59.970302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-42d6237c-07c2-4c71-9c45-d9393e9ae584 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:36:59.971486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-42d6237c-07c2-4c71-9c45-d9393e9ae584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:00.035632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 504/1011] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:36:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:00.141510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509a38b-1a4a-452c-90ed-433dd1012f2f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.193177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:00.244315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509a38b-1a4a-452c-90ed-433dd1012f2f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.278289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.278940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.279219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.279487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.280127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.281561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.299126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6237c-07c2-4c71-9c45-d9393e9ae584 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.317170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:00.394509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6237c-07c2-4c71-9c45-d9393e9ae584 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.403367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 508/1012] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:37:00 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:00.440574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.441224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.441499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.441764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.442347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.443782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:00.454440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:00.455521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:00.456387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 505/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:00.462820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.572027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440ad3d-7baf-4d7d-8712-f9efae377a25 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.583763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:00.609106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.609720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.609989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.610257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.611064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:00.611370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.612734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.617971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 509/1014] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:37:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:00.623729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.712382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:00.736570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a013b-fde3-4b77-8720-b3b02cfdd77f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.772476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b41841-f05e-4274-ae05-5aa26ad67e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.773077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b41841-f05e-4274-ae05-5aa26ad67e16 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.773350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b41841-f05e-4274-ae05-5aa26ad67e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.773617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b41841-f05e-4274-ae05-5aa26ad67e16 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.774235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b41841-f05e-4274-ae05-5aa26ad67e16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:00.774530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b41841-f05e-4274-ae05-5aa26ad67e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.775902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b41841-f05e-4274-ae05-5aa26ad67e16 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.785849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 506/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Fri Oct 28 09:37:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:00.787853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:00.838979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbba3d-a7ad-4d73-b18a-1c660d71baa4 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.839277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbba3d-a7ad-4d73-b18a-1c660d71baa4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.839528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbba3d-a7ad-4d73-b18a-1c660d71baa4 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.841487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 507/1016] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:00.846195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a66dd6-c484-4872-94dd-eaaa389863cf None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.846481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a66dd6-c484-4872-94dd-eaaa389863cf None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.846785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a66dd6-c484-4872-94dd-eaaa389863cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.864762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-37a66dd6-c484-4872-94dd-eaaa389863cf None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:00.865944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-37a66dd6-c484-4872-94dd-eaaa389863cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:00.892300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e8a72-b007-4ab4-8fac-6079ea8720b5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:00.930700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:00.930700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:00.931005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:00.934701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:00.934701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:00.934701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:00.935393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 508/1017] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:00 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:01.013844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 510/1018] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:37:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:01.215508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a66dd6-c484-4872-94dd-eaaa389863cf None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:01.292551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:01.326700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a66dd6-c484-4872-94dd-eaaa389863cf None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:01.365277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094aa2f-fe81-4aa4-a34a-7779bd174cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:01.365906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094aa2f-fe81-4aa4-a34a-7779bd174cbc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:01.366181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094aa2f-fe81-4aa4-a34a-7779bd174cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:01.366452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094aa2f-fe81-4aa4-a34a-7779bd174cbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:01.367579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094aa2f-fe81-4aa4-a34a-7779bd174cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:01.369004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094aa2f-fe81-4aa4-a34a-7779bd174cbc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:01.370562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 509/1019] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:01.377045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:01.409279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:01.479556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0ac57-eb61-4507-b57d-b574f6a05eb0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:01.513996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176564de-70d5-45ee-bd1b-09b158e7a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:01.514598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176564de-70d5-45ee-bd1b-09b158e7a5bd None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:01.514911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176564de-70d5-45ee-bd1b-09b158e7a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:01.515182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176564de-70d5-45ee-bd1b-09b158e7a5bd None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:01.515820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176564de-70d5-45ee-bd1b-09b158e7a5bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:01.517284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176564de-70d5-45ee-bd1b-09b158e7a5bd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:01.607821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 511/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:37:01 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:02.597919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2461b-86f4-4121-803d-b21850cbf7b5 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:02.598445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2461b-86f4-4121-803d-b21850cbf7b5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:02.598445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2461b-86f4-4121-803d-b21850cbf7b5 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:02.599983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 510/1021] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:02.604963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5c494-4dfa-4e80-9809-fc798edf8824 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:02.605360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5c494-4dfa-4e80-9809-fc798edf8824 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:02.605529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5c494-4dfa-4e80-9809-fc798edf8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:02.623831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-78d5c494-4dfa-4e80-9809-fc798edf8824 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:02.624982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-78d5c494-4dfa-4e80-9809-fc798edf8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:02.696316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 512/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:02.960008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2461b-86f4-4121-803d-b21850cbf7b5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.059142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2461b-86f4-4121-803d-b21850cbf7b5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.092481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.093099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.093370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.093628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] PATH_INFO: `/v3/services/image` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.094191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.095565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:03.098179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:03.105606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:03.106578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:37:03.107467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:03.108995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 511/1023] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Oct 28 09:37:02 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:03.112556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5c494-4dfa-4e80-9809-fc798edf8824 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.127226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:03.216234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5c494-4dfa-4e80-9809-fc798edf8824 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.249836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bd01f-5ade-446c-b37c-25e8ad56acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.250441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bd01f-5ade-446c-b37c-25e8ad56acfe None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.250738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bd01f-5ade-446c-b37c-25e8ad56acfe None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.251004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bd01f-5ade-446c-b37c-25e8ad56acfe None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.251618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bd01f-5ade-446c-b37c-25e8ad56acfe None admin] RBAC: Adding query filter params (name=image) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:03.251912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bd01f-5ade-446c-b37c-25e8ad56acfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.253269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bd01f-5ade-446c-b37c-25e8ad56acfe None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:03.262774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 513/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:03.263960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.286872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998288aa-bac9-441d-8098-9d921a91f0cc None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.287162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998288aa-bac9-441d-8098-9d921a91f0cc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.287429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998288aa-bac9-441d-8098-9d921a91f0cc None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.288892 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 514/1025] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:03.294155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1bea-3ab1-4641-8df9-6c7fa1c05730 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.294460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1bea-3ab1-4641-8df9-6c7fa1c05730 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.294782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac1bea-3ab1-4641-8df9-6c7fa1c05730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.314663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a2ac1bea-3ab1-4641-8df9-6c7fa1c05730 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:03.315875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a2ac1bea-3ab1-4641-8df9-6c7fa1c05730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:03.367704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ee25-0959-45c3-8c1e-8942a2279221 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.387603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 515/1026] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:03.403358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.404223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.404708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.405183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.406029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] RBAC: Adding query filter params (type=image) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:03.406550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.408145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:03.413512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 512/1027] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:03.419686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac1bea-3ab1-4641-8df9-6c7fa1c05730 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.428236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:03.518326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac1bea-3ab1-4641-8df9-6c7fa1c05730 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.552165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.552764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.553035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.553300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.553989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] RBAC: Adding query filter params (interface=public, service_id=ca93cdd42ca64435b99eeea155e55e4e, region_id=RegionOne) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:03.554287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.555676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:03.565427 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 516/1028] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:37:03 2022] GET /identity/v3/endpoints?service_id=ca93cdd42ca64435b99eeea155e55e4e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:03.566382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.629845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:03.653113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.672302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7a299-483c-4ed7-89dd-99ad1fa0779f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.719468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7c6eb-dd28-41db-995e-b665ef9be9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.720404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7c6eb-dd28-41db-995e-b665ef9be9ef None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.720844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7c6eb-dd28-41db-995e-b665ef9be9ef None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.721131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7c6eb-dd28-41db-995e-b665ef9be9ef None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.721755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7c6eb-dd28-41db-995e-b665ef9be9ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.723426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7c6eb-dd28-41db-995e-b665ef9be9ef None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:03.731363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:03.731634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 513/1029] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:37:03 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:37:03.770377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17925-cb6c-4f61-85fd-32ac019b4f7c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.807798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.808492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.808769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.809041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.820741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:03.821167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef853ef-369a-483a-8ea0-1006e82f7cc7 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.821454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef853ef-369a-483a-8ea0-1006e82f7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.821730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef853ef-369a-483a-8ea0-1006e82f7cc7 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.823322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 514/1030] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:03.826920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:03.827896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:03.828761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 517/1031] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 09:37:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:03.831510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876922-514a-4660-b7ef-5c441e9f416f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.831794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876922-514a-4660-b7ef-5c441e9f416f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.832075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1876922-514a-4660-b7ef-5c441e9f416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.833806 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:03.851828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a1876922-514a-4660-b7ef-5c441e9f416f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:03.853058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a1876922-514a-4660-b7ef-5c441e9f416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:03.930694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 515/1032] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:03.949416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae95dc-1b58-41eb-af25-50b76427bde2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:03.978385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:03.984468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:03.985076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:03.985351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:03.985619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:03.986267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:03.986566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:03.988100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.001357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 518/1033] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 09:37:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:04.002564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1876922-514a-4660-b7ef-5c441e9f416f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:04.062011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:04.102959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1876922-514a-4660-b7ef-5c441e9f416f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:04.137150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:04.137803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:04.138047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:04.138309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:04.148365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:04.149858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:04.164079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:04.165012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:04.166520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:04.166520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:04.166520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:04.166520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 516/1034] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:04.171044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:04.201094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:04.273462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca422722-7e21-4aeb-8055-d07cc74a0ec3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:04.306110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4a6ba-7bee-4f60-8c3f-c31e53721c43 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:04.308571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:04.309286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:04.309561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:04.309824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:04.310456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:04.310778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:04.312244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.317270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:04.325698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 519/1035] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:04.331121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:04.341852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:04.342485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:04.342794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:04.343069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:04.344189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:04.345634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.347239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 517/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:04.352880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:04.390092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:04.440351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cad47-f0a7-4485-acd3-591364cca464 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:04.455742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50f588-6982-4f66-a23a-24316fe19e66 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:04.475111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:04.475854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:04.476129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:04.476393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:04.486062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:04.487621 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.490475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:04.491113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:04.491396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:04.491667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:04.492317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:04.493725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:04.500795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:04.501731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:37:04.502711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:04.504011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 520/1037] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:37:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:04.509486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:04.602790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 518/1038] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:37:04 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:37:04.624237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a4750-a1f7-46bc-81b5-5d45f3593806 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:04.640721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:04.665120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:04.665784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:04.666131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:04.666400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:04.667741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:04.668059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:04.669529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.692713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 521/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:37:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:04.698414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:04.735731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:04.809621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a97b-84aa-4633-b0b4-69b517006211 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:04.843196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:04.843803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:04.844079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:04.844348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:04.913494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:04.914874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:04.947009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:05.012920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 519/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:05.018719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:05.121260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f77631-a9f2-4bc1-9b01-2fff6000f6f8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:05.158151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:05.158819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.159093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.159357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.169531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:05.171124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:05.185758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:05.191557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:05.192717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:05.192717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:05.192717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:05.192717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 522/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:05.194160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:05.294225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46451783-027a-4b13-b2c6-9ad96ff3bab9 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:05.328352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:05.328961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.329236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.329503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.330135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:05.330434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:05.331812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:05.333241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:05.349099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 520/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:05.350907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:05.376379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:05.454283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d54b3-c834-4cca-826c-7201452974f1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:05.488166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:05.488790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.489071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.489340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.495942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:05.497410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:05.508466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:05.509329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:05.515949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 523/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:05.517910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:05.623142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff59d0b-22b7-4634-9bc9-d231da2e6eb6 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:05.656625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdc51b-3e02-447d-8e0d-557fb9f4bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:05.657228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdc51b-3e02-447d-8e0d-557fb9f4bd82 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.657502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdc51b-3e02-447d-8e0d-557fb9f4bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.657773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdc51b-3e02-447d-8e0d-557fb9f4bd82 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.658452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdc51b-3e02-447d-8e0d-557fb9f4bd82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:05.658779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdc51b-3e02-447d-8e0d-557fb9f4bd82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:05.660195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdc51b-3e02-447d-8e0d-557fb9f4bd82 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:05.677432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 521/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:05.678803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:05.768452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:05.786533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ec5c-d767-4440-9c0d-b104ed3ff1fe None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:05.826696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c82e61-1f8b-4176-8df6-50ec6918560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:05.827310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c82e61-1f8b-4176-8df6-50ec6918560c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.827590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c82e61-1f8b-4176-8df6-50ec6918560c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.827860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c82e61-1f8b-4176-8df6-50ec6918560c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.828613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c82e61-1f8b-4176-8df6-50ec6918560c None admin] RBAC: Adding query filter params (role.id=b0228ec93bda4d5f87d6bfb26aa20af2, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=47f38d07f1c44175af29a9dfe93f0f37) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:05.828922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c82e61-1f8b-4176-8df6-50ec6918560c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:05.830351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c82e61-1f8b-4176-8df6-50ec6918560c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:05.842942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 524/1045] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:05 2022] GET /identity/v3/role_assignments?user.id=47f38d07f1c44175af29a9dfe93f0f37&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=b0228ec93bda4d5f87d6bfb26aa20af2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:05.915857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a851e-6f71-41af-a644-5a7c6ee17b74 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.916421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a851e-6f71-41af-a644-5a7c6ee17b74 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.916421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a851e-6f71-41af-a644-5a7c6ee17b74 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.918276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 522/1046] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:05.924034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802617cc-0895-4d19-83af-aecab6c5cf6e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:05.924315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802617cc-0895-4d19-83af-aecab6c5cf6e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:05.924584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802617cc-0895-4d19-83af-aecab6c5cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:05.943910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-802617cc-0895-4d19-83af-aecab6c5cf6e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:05.945100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-802617cc-0895-4d19-83af-aecab6c5cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:06.015839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 525/1047] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:06.286580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a851e-6f71-41af-a644-5a7c6ee17b74 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.343730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.388678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a851e-6f71-41af-a644-5a7c6ee17b74 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.423113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.423739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.424009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.424273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] PATH_INFO: `/v3/services/image` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.424841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.426181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:06.434799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:06.435776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 09:37:06.436610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:06.439663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 523/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:06.441716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802617cc-0895-4d19-83af-aecab6c5cf6e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.516531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.540026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802617cc-0895-4d19-83af-aecab6c5cf6e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.574410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.575039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.575310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.575569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.576179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] RBAC: Adding query filter params (name=image) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:06.576471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.577821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.582826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 526/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:06.588241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.695534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba6f7-3417-46e1-b4ea-cb89ebe3bc8c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.716674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.735195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d275328-6ce1-4760-9435-dcc1d71795b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.735903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d275328-6ce1-4760-9435-dcc1d71795b1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.736226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d275328-6ce1-4760-9435-dcc1d71795b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.736488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d275328-6ce1-4760-9435-dcc1d71795b1 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.737114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d275328-6ce1-4760-9435-dcc1d71795b1 None admin] RBAC: Adding query filter params (type=image) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:06.737409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d275328-6ce1-4760-9435-dcc1d71795b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.738782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d275328-6ce1-4760-9435-dcc1d71795b1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.743814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 524/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:06.749335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:06.811502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94ab2-a77f-4811-be37-693ad7e87dd3 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.811794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94ab2-a77f-4811-be37-693ad7e87dd3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.812071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce94ab2-a77f-4811-be37-693ad7e87dd3 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.813421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 525/1051] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:06.818320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57c219-48b6-433d-99d1-a4b11b696377 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.818600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57c219-48b6-433d-99d1-a4b11b696377 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.818903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57c219-48b6-433d-99d1-a4b11b696377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.837760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ff57c219-48b6-433d-99d1-a4b11b696377 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:06.838980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ff57c219-48b6-433d-99d1-a4b11b696377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:06.853533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde62842-e0ac-4649-bb94-bdf3cdfad840 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:06.887193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:06.887806 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:06.888082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:06.888352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:06.889022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:06.890394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:06.899760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:06.909544 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 526/1052] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:06.966156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 527/1053] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:37:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:07.178611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57c219-48b6-433d-99d1-a4b11b696377 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.276894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57c219-48b6-433d-99d1-a4b11b696377 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.289917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.316848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.317472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.317747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.318012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.329233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:07.333959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:07.335127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:07.336029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 527/1054] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:07.342598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.443308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9c7f4-e9f3-4a9c-b7c3-5808550ee628 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.476294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.476902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.477182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.477443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.478095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:07.478396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.480313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.489486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 528/1055] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:07.494786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.593398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341760-0f52-4ba8-920d-4fd39ffed102 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.627251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.627876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.628152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.628414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] PATH_INFO: `/v3/users/651097cdb11e4f8a86dd9411f3d825c8` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.641643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=651097cdb11e4f8a86dd9411f3d825c8)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.643113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.644777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 528/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/users/651097cdb11e4f8a86dd9411f3d825c8 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:07.650741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:07.717469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.761322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00efe2-217e-4a5b-bb98-85713ab74d5a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:07.795629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aec23f-0b72-49aa-b0c3-160697df4eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:07.796238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec23f-0b72-49aa-b0c3-160697df4eca None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:07.796541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec23f-0b72-49aa-b0c3-160697df4eca None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:07.796777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec23f-0b72-49aa-b0c3-160697df4eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:07.863369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aec23f-0b72-49aa-b0c3-160697df4eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:07.864828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aec23f-0b72-49aa-b0c3-160697df4eca None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:07.927912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:07.978793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 529/1057] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:07.981578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.000847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485f2ce-9e88-4049-853c-682992fedf49 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.001133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485f2ce-9e88-4049-853c-682992fedf49 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.001411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485f2ce-9e88-4049-853c-682992fedf49 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.002947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 530/1058] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:08.007754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d041d23-8806-4cc2-8db1-608f6db63c32 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.008057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d041d23-8806-4cc2-8db1-608f6db63c32 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.008333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d041d23-8806-4cc2-8db1-608f6db63c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.009912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:08.026315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4d041d23-8806-4cc2-8db1-608f6db63c32 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:08.028044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4d041d23-8806-4cc2-8db1-608f6db63c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:08.088320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25201fac-238e-4450-943f-c56c25139fa3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.095739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 531/1059] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:08.124085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.124714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.124990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.125259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.126363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf9e0297acb446ba93c1940556a22ec)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:08.127823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:08.129632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 529/1060] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:07 2022] GET /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:08.135426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d041d23-8806-4cc2-8db1-608f6db63c32 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.224158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:08.236635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d041d23-8806-4cc2-8db1-608f6db63c32 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.270138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.271022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.271296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.271561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.272269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=fdf9e0297acb446ba93c1940556a22ec, user.id=651097cdb11e4f8a86dd9411f3d825c8) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:08.272568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:08.274050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:08.281075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 532/1061] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:08 2022] GET /identity/v3/role_assignments?user.id=651097cdb11e4f8a86dd9411f3d825c8&scope.project.id=fdf9e0297acb446ba93c1940556a22ec&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:08.371416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.472135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:08.478601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d9fff-34c0-4fe9-a826-9e9c96657cb8 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.512491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.513035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.513305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.513569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.523909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:08.529242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:08.530157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:37:08.531355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:08.534727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 530/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 09:37:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:08.536328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.635508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fade9-354a-45fc-8723-11ba6c473ad3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.669146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.669743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.670019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.670281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.670961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:08.671261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:08.672635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:08.688179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 533/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 09:37:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:08.693706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.796248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95110aca-836d-453a-b26b-6074ef79ca75 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:08.830652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:08.831292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:08.831567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:08.831836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:08.842508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:08.844045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:08.858091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:08.859263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:08.860179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:08.860179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:08.860179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:08.862819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 531/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:08.864924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:08.880849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:08.965753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fb00f-e056-46ac-a30f-644770175c37 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.001439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa0d2b-06db-4256-af77-83a87dc8ce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:09.002041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0d2b-06db-4256-af77-83a87dc8ce14 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.002313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0d2b-06db-4256-af77-83a87dc8ce14 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.002575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa0d2b-06db-4256-af77-83a87dc8ce14 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.003230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa0d2b-06db-4256-af77-83a87dc8ce14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:09.003536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa0d2b-06db-4256-af77-83a87dc8ce14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:09.004877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa0d2b-06db-4256-af77-83a87dc8ce14 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:09.020994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 534/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:09.022245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.032107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:09.128687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c4d1a-a365-47f0-859a-d953972fe409 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.161595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:09.162231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.162507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.162802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.172026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:09.173503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:09.179372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6087-ff8b-4c30-9690-0a5ca442d00b None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.179659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6087-ff8b-4c30-9690-0a5ca442d00b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.179925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d6087-ff8b-4c30-9690-0a5ca442d00b None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.181413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 535/1066] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:09.186891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:09.187820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:37:09.188797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:09.189327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef145c-812b-43c2-a1bf-155d9f50c11e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.189327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef145c-812b-43c2-a1bf-155d9f50c11e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.189327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef145c-812b-43c2-a1bf-155d9f50c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.189512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 532/1067] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:09.193803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.206065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-bfef145c-812b-43c2-a1bf-155d9f50c11e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:09.207267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bfef145c-812b-43c2-a1bf-155d9f50c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:09.266884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:09.278342 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 536/1068] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:09.302987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54e5a-c235-4ce8-8226-6f7d500d5e08 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.336203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:09.336796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.337070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.337336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.338046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:09.338342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:09.340323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:09.357883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 533/1069] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:09.365602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef145c-812b-43c2-a1bf-155d9f50c11e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.367884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:09.464792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef145c-812b-43c2-a1bf-155d9f50c11e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.498346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:09.499000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.499280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.499548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.509558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:09.511077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:09.525757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:09.527297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:09.528198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:09.528198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:09.528198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:09.531023 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 537/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:09.533431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.549773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.607839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:09.640905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934a84b-535c-4ff7-8e55-a4d57d8cb2de None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.655527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aba8f2-6ebc-4ee6-8c22-cc7de1a6a0ff None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.666574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:09.679589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:09.680197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.680474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.680739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.681376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:09.681678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:09.683169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:09.693224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b82f5-9515-43df-9760-02623a274179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:09.693907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b82f5-9515-43df-9760-02623a274179 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.694233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b82f5-9515-43df-9760-02623a274179 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.694600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b82f5-9515-43df-9760-02623a274179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.699837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 534/1071] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:09.705246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.766582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b82f5-9515-43df-9760-02623a274179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:09.768098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b82f5-9515-43df-9760-02623a274179 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:09.809767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222383a3-2665-4845-af5b-f97dd17ae86d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.825894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:09.845101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:09.845841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:09.846026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:09.846259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:09.853510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:09.855180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:09.866993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:09.867877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:09.869386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 535/1072] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:09.873907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.874532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 538/1073] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:09.880361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b82f5-9515-43df-9760-02623a274179 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:09.924680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:09.985750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4fe73-7fe0-4374-b1a3-cf49afe32e1c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:09.985953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b82f5-9515-43df-9760-02623a274179 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.021786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.022301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.022935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.023216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.023489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.023592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.024045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.024159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:10.024465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.024819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.025898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.035998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.037719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.040166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 536/1074] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:10.046079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:10.053391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:10.054331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:10.055332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:10.055332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:10.055332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:10.055332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 539/1075] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:10.060905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.072000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:10.156395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0428-875f-47d6-a3ab-508a134fafbc None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.159537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:10.172267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fad47-2fb6-4cb8-8ca8-47392b47c86b None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.193868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8130d98-b4f5-4f47-9330-a94dbe79a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.194533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8130d98-b4f5-4f47-9330-a94dbe79a367 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.196523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8130d98-b4f5-4f47-9330-a94dbe79a367 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.197323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8130d98-b4f5-4f47-9330-a94dbe79a367 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/47f38d07f1c44175af29a9dfe93f0f37/roles/b0228ec93bda4d5f87d6bfb26aa20af2` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.200666 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8130d98-b4f5-4f47-9330-a94dbe79a367 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=47f38d07f1c44175af29a9dfe93f0f37, role_id=b0228ec93bda4d5f87d6bfb26aa20af2)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.202437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8130d98-b4f5-4f47-9330-a94dbe79a367 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.208627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07c2e-534d-4743-b2d7-10f74a4face3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.209240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07c2e-534d-4743-b2d7-10f74a4face3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.209511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07c2e-534d-4743-b2d7-10f74a4face3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.209782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07c2e-534d-4743-b2d7-10f74a4face3 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.210417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a07c2e-534d-4743-b2d7-10f74a4face3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:10.210742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a07c2e-534d-4743-b2d7-10f74a4face3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:10.212098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a07c2e-534d-4743-b2d7-10f74a4face3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:10.223793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 540/1076] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:10.282143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 537/1077] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:37:10 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/47f38d07f1c44175af29a9dfe93f0f37/roles/b0228ec93bda4d5f87d6bfb26aa20af2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:37:10.465154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb56d-2bf0-492a-ba6a-eaf18c7f304d None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.465472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb56d-2bf0-492a-ba6a-eaf18c7f304d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.465695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb56d-2bf0-492a-ba6a-eaf18c7f304d None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.467067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 541/1078] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:10.472700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27401f-598f-43c5-9d5b-86b1fcb54d88 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.473236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27401f-598f-43c5-9d5b-86b1fcb54d88 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.473691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27401f-598f-43c5-9d5b-86b1fcb54d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.493073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3a27401f-598f-43c5-9d5b-86b1fcb54d88 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:10.494260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3a27401f-598f-43c5-9d5b-86b1fcb54d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:10.569625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 538/1079] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:10.837862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb56d-2bf0-492a-ba6a-eaf18c7f304d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:10.904048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:10.937565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb56d-2bf0-492a-ba6a-eaf18c7f304d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:10.970186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:10.970836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:10.971110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:10.971378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:10.981609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:10.986285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:10.987404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:10.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 542/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:10.993353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27401f-598f-43c5-9d5b-86b1fcb54d88 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:11.083325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:11.091417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27401f-598f-43c5-9d5b-86b1fcb54d88 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:11.122603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:11.131680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:11.131680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:11.131680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:11.131680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:11.131680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:11.131680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:11.134439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 539/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:11.140650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:11.240508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12ba3c-cd7a-47d5-ace8-a6c6b9cb30bc None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:11.265598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:11.273021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:11.273632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:11.273930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:11.277506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] PATH_INFO: `/v3/users/651097cdb11e4f8a86dd9411f3d825c8` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:11.277506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] RBAC: Authorizing `identity:get_user(user_id=651097cdb11e4f8a86dd9411f3d825c8)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:11.277506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:11.278554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 543/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:11 2022] GET /identity/v3/users/651097cdb11e4f8a86dd9411f3d825c8 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:11.283987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:11.380189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6273f7-ae66-43f7-8965-0a1610e9de3c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:11.411725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1f8c5-9900-4122-9566-feb398c79bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:11.412338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1f8c5-9900-4122-9566-feb398c79bfe None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:11.412612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1f8c5-9900-4122-9566-feb398c79bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:11.412877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1f8c5-9900-4122-9566-feb398c79bfe None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:11.413973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1f8c5-9900-4122-9566-feb398c79bfe None admin] RBAC: Authorizing `identity:get_project(project_id=fdf9e0297acb446ba93c1940556a22ec)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:11.415415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1f8c5-9900-4122-9566-feb398c79bfe None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:11.417538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 540/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:11 2022] GET /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:11.423371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:11.519585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573788bb-f8a4-4b3d-983c-7ccbcc3e6851 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:11.552321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad514a-a9d5-4641-aafe-719af8fe838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:11.552965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad514a-a9d5-4641-aafe-719af8fe838c None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:11.553239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad514a-a9d5-4641-aafe-719af8fe838c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:11.553507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad514a-a9d5-4641-aafe-719af8fe838c None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec/users/651097cdb11e4f8a86dd9411f3d825c8/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:11.555334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad514a-a9d5-4641-aafe-719af8fe838c None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf9e0297acb446ba93c1940556a22ec, user_id=651097cdb11e4f8a86dd9411f3d825c8, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:11.556760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad514a-a9d5-4641-aafe-719af8fe838c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:11.634123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 544/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:37:11 2022] PUT /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec/users/651097cdb11e4f8a86dd9411f3d825c8/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:37:12.453454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33205-8582-461c-b86f-f84cbc487ae3 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:12.453983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33205-8582-461c-b86f-f84cbc487ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:12.453983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33205-8582-461c-b86f-f84cbc487ae3 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:12.455357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 541/1085] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:12.460693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ac01-3eb3-4e7a-a089-9f4f24439621 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:12.461133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ac01-3eb3-4e7a-a089-9f4f24439621 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:12.461225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6ac01-3eb3-4e7a-a089-9f4f24439621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:12.481335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6af6ac01-3eb3-4e7a-a089-9f4f24439621 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:12.482548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6af6ac01-3eb3-4e7a-a089-9f4f24439621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:12.532223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:12.548784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 545/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:12.820971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33205-8582-461c-b86f-f84cbc487ae3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:12.847695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:12.921924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33205-8582-461c-b86f-f84cbc487ae3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:12.953729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:12.954344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:12.954617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:12.954937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:12.965572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:12.970333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:12.971507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:12.972770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 542/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Fri Oct 28 09:37:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:12.977474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6ac01-3eb3-4e7a-a089-9f4f24439621 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.072288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6ac01-3eb3-4e7a-a089-9f4f24439621 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.104863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.105453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.105727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.105996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.106643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:13.106969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.108323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.116227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 546/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 09:37:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:13.122424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.204071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.218922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fd7f2-c463-4535-b32a-3ff6dc5f4869 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.251783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.252389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.252659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.252923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.263574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.265000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:13.278825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:13.279957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:13.281006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:13.281006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:13.281006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:13.282827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 543/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:13.285628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.333684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.383172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7bdc-71e6-4b54-a77d-440f5abd0358 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.415420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.416016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.416287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.416549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.417703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:13.417998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.419384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.430521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 547/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:13.436719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.531801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12639887-1955-4d18-8d18-7408d7cc242e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.564515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6254a-805b-44e8-900e-4937579409c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.565132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6254a-805b-44e8-900e-4937579409c0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.565408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6254a-805b-44e8-900e-4937579409c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.565676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6254a-805b-44e8-900e-4937579409c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.568297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.573209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6254a-805b-44e8-900e-4937579409c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.574662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6254a-805b-44e8-900e-4937579409c0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e8b6254a-805b-44e8-900e-4937579409c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:37:13.590760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:13.591940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:13.592967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 544/1091] 10.222.0.49 () {56 vars in 1093 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:13.593563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.698706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d18041-8c72-4952-88f0-51ff66f81619 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.707861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.731860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.732644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.732781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.732986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.733704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:13.734008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.734100 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0631-f385-4a71-8391-8d0c20a788b2 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.734352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0631-f385-4a71-8391-8d0c20a788b2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.734624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0631-f385-4a71-8391-8d0c20a788b2 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.735457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:13.735973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 545/1092] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:37:13.740872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b709-cd62-4703-bcd7-2f71961b2824 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.741150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b709-cd62-4703-bcd7-2f71961b2824 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.741416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b709-cd62-4703-bcd7-2f71961b2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.753816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 548/1093] 10.222.0.49 () {56 vars in 1133 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:13.759454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:13.759729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7c04b709-cd62-4703-bcd7-2f71961b2824 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:13.760898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7c04b709-cd62-4703-bcd7-2f71961b2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:13.826125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 546/1094] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:37:13.855234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a778c-20e1-44b5-bc2b-033e25e70543 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:13.887469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:13.888054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:13.888324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:13.888593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:13.920812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:13.953421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:13.954900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.048630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 549/1095] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:14.054384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b709-cd62-4703-bcd7-2f71961b2824 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.092317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.151885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b709-cd62-4703-bcd7-2f71961b2824 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.156721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.176766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.185299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63db44-3be0-4314-abeb-425be088501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.185968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63db44-3be0-4314-abeb-425be088501e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.186278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63db44-3be0-4314-abeb-425be088501e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.186822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63db44-3be0-4314-abeb-425be088501e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.189270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9a78-3f9b-45d1-ace7-4c10c3908621 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.196306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63db44-3be0-4314-abeb-425be088501e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.198311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63db44-3be0-4314-abeb-425be088501e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-df63db44-3be0-4314-abeb-425be088501e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:14.212804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:14.214298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:37:14.215484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:14.215484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:37:14.215484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:14.215484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 547/1096] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:14.220237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63db44-3be0-4314-abeb-425be088501e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.228782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.229433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.229705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.229973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.239742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:14.244932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:14.246018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:14.247051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 550/1097] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:37:14.251826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.320172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63db44-3be0-4314-abeb-425be088501e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.346220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1a52d-11b4-45ae-834b-2118e15609ca None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.353510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.354596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.354898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.355174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.355799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:14.356094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.357445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.368845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 548/1098] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:14.371303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.374932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.380068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.380661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.380933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.381197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.386121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:14.386121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.386121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.391938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 551/1099] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:14.398273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.414539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.472721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa17bf-a3ff-48e3-bafa-fcfacc12d720 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.495619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9e0e-4756-4f33-8330-f5e03fbe19f1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.506280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.506915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.507188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.507453 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.513908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.515359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:37:14.527310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:14.528177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:14.529089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 549/1100] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:14.529579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.529579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.529729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.530240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] PATH_INFO: `/v3/users/651097cdb11e4f8a86dd9411f3d825c8` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.531049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] RBAC: Authorizing `identity:get_user(user_id=651097cdb11e4f8a86dd9411f3d825c8)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.532478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.534063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.534541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 552/1101] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/users/651097cdb11e4f8a86dd9411f3d825c8 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:14.539761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.595032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.628232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.631917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9a1d6-9422-421d-995d-97b7e7ef1280 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.638438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d801f-655b-496c-85e1-d04b18ac1c20 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.665592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.666126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.666398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.666713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.667426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:14.667724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.669127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.671105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.671703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.671976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.672242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.681045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 550/1102] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:14.687525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.741324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.742825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.785041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36865f6-1652-436d-8e5e-23dab7ec209c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.795979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.819098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.819680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.819950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.820211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.820967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] RBAC: Adding query filter params (role.id=b0228ec93bda4d5f87d6bfb26aa20af2, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=47f38d07f1c44175af29a9dfe93f0f37) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:14.821267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.822696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.830776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 551/1103] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/role_assignments?user.id=47f38d07f1c44175af29a9dfe93f0f37&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=b0228ec93bda4d5f87d6bfb26aa20af2 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:14.844232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 553/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 09:37:14.850424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:14.876652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:14.956873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25223a27-3b57-4340-9d43-816f16afaafe None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:14.991930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989644e9-072c-45c9-a587-5a914413562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:14.992565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989644e9-072c-45c9-a587-5a914413562f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:14.992836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989644e9-072c-45c9-a587-5a914413562f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:14.993103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989644e9-072c-45c9-a587-5a914413562f None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:14.994231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989644e9-072c-45c9-a587-5a914413562f None admin] RBAC: Authorizing `identity:get_project(project_id=fdf9e0297acb446ba93c1940556a22ec)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:14.995752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989644e9-072c-45c9-a587-5a914413562f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:14.997379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 552/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:14 2022] GET /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:37:15.003615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:15.104655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79185968-d1f4-46f8-af72-27408af1cdf2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:15.138418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2db6-6176-4f9c-a660-0943d8fc3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:15.139041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2db6-6176-4f9c-a660-0943d8fc3659 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:15.139313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2db6-6176-4f9c-a660-0943d8fc3659 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:15.139576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2db6-6176-4f9c-a660-0943d8fc3659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:15.140281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2db6-6176-4f9c-a660-0943d8fc3659 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=fdf9e0297acb446ba93c1940556a22ec, user.id=651097cdb11e4f8a86dd9411f3d825c8) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:15.140582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2db6-6176-4f9c-a660-0943d8fc3659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:15.142000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2db6-6176-4f9c-a660-0943d8fc3659 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:15.148068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 554/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:15 2022] GET /identity/v3/role_assignments?user.id=651097cdb11e4f8a86dd9411f3d825c8&scope.project.id=fdf9e0297acb446ba93c1940556a22ec&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:17.315332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcc13-2a78-4ea0-8077-ba41049939d8 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:17.315929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcc13-2a78-4ea0-8077-ba41049939d8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:17.315929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcc13-2a78-4ea0-8077-ba41049939d8 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:17.317210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 553/1107] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:17.322454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940ce3a-69c8-4ab9-8d98-fa41bb4774cb None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:17.322925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940ce3a-69c8-4ab9-8d98-fa41bb4774cb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:17.323025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940ce3a-69c8-4ab9-8d98-fa41bb4774cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:17.340651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4940ce3a-69c8-4ab9-8d98-fa41bb4774cb None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:17.341817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4940ce3a-69c8-4ab9-8d98-fa41bb4774cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:17.355918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:17.406404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 555/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:17.672864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcc13-2a78-4ea0-8077-ba41049939d8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:17.760731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:17.771169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcc13-2a78-4ea0-8077-ba41049939d8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:17.804544 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea6aae-d32f-469c-ba92-44489ed3750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:17.805157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6aae-d32f-469c-ba92-44489ed3750f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:17.805433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6aae-d32f-469c-ba92-44489ed3750f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:17.805706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea6aae-d32f-469c-ba92-44489ed3750f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:17.806837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea6aae-d32f-469c-ba92-44489ed3750f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:17.808277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea6aae-d32f-469c-ba92-44489ed3750f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:17.809824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 554/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:17.815562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940ce3a-69c8-4ab9-8d98-fa41bb4774cb None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:17.910358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940ce3a-69c8-4ab9-8d98-fa41bb4774cb None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:17.942188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932b887-2124-41b9-b1b5-8e44ac5eda2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:17.942743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b887-2124-41b9-b1b5-8e44ac5eda2a None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:17.943023 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b887-2124-41b9-b1b5-8e44ac5eda2a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:17.943295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b887-2124-41b9-b1b5-8e44ac5eda2a None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:17.943934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932b887-2124-41b9-b1b5-8e44ac5eda2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:17.945356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932b887-2124-41b9-b1b5-8e44ac5eda2a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:18.055456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 556/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:37:17 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:20.210277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424f890-ca0f-4ec1-b0e3-a82e7bef7392 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.210853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424f890-ca0f-4ec1-b0e3-a82e7bef7392 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.210853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424f890-ca0f-4ec1-b0e3-a82e7bef7392 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:20.212274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 555/1111] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:20.217437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711273f-ec02-4d8c-bb3f-7bea1dcc03c9 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.217896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711273f-ec02-4d8c-bb3f-7bea1dcc03c9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.218001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711273f-ec02-4d8c-bb3f-7bea1dcc03c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:20.231226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:20.236500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-3711273f-ec02-4d8c-bb3f-7bea1dcc03c9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:20.239523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3711273f-ec02-4d8c-bb3f-7bea1dcc03c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:20.302372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 557/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:20.568686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424f890-ca0f-4ec1-b0e3-a82e7bef7392 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:20.667386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424f890-ca0f-4ec1-b0e3-a82e7bef7392 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:20.701122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:20.701740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.702013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.702278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] PATH_INFO: `/v3/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:20.703643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] RBAC: Authorizing `identity:get_role(role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:20.704992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:20.706292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 556/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:20 2022] GET /identity/v3/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:20.712246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711273f-ec02-4d8c-bb3f-7bea1dcc03c9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:20.807410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711273f-ec02-4d8c-bb3f-7bea1dcc03c9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:20.840149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:20.840706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.840978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.841244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] PATH_INFO: `/v3/users/e281a51fe3b3490b9e8fc76698812088` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:20.843837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:20.853781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] RBAC: Authorizing `identity:get_user(user_id=e281a51fe3b3490b9e8fc76698812088)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:20.855263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:20.856867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 558/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:20 2022] GET /identity/v3/users/e281a51fe3b3490b9e8fc76698812088 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:20.862534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:20.889698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:20.958866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bf7f0-0d4c-412d-8746-14eaee0c1bb0 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:20.991466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:20.992053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:20.992365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:20.992638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:21.056334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:21.058363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:21.082514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:21.152319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 557/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:21.158067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:21.254207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8974f-bfe6-47e7-b930-07a4208c94a4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:21.286835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc0fd-c15c-4479-828f-9bda977703cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:21.287449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc0fd-c15c-4479-828f-9bda977703cb None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:21.287723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc0fd-c15c-4479-828f-9bda977703cb None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:21.287991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc0fd-c15c-4479-828f-9bda977703cb None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:21.289093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dc0fd-c15c-4479-828f-9bda977703cb None admin] RBAC: Authorizing `identity:get_project(project_id=fdf9e0297acb446ba93c1940556a22ec)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:21.290519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dc0fd-c15c-4479-828f-9bda977703cb None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:21.292739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 559/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:21 2022] GET /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:21.298891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:21.392718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2dac-5d23-4e64-89e9-58ba87a9df58 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:21.418183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:21.426373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cfd78-48ae-41f6-811c-645f569fcf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:21.426988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cfd78-48ae-41f6-811c-645f569fcf90 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:21.430910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cfd78-48ae-41f6-811c-645f569fcf90 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:21.430910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cfd78-48ae-41f6-811c-645f569fcf90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:21.430910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cfd78-48ae-41f6-811c-645f569fcf90 None admin] RBAC: Adding query filter params (role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=fdf9e0297acb446ba93c1940556a22ec, user.id=e281a51fe3b3490b9e8fc76698812088) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:21.430910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cfd78-48ae-41f6-811c-645f569fcf90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:21.430910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cfd78-48ae-41f6-811c-645f569fcf90 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:21.434976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 558/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:21 2022] GET /identity/v3/role_assignments?user.id=e281a51fe3b3490b9e8fc76698812088&scope.project.id=fdf9e0297acb446ba93c1940556a22ec&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:23.512453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace2383-8d36-41bf-a468-9dfe0d3156e8 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:23.512979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace2383-8d36-41bf-a468-9dfe0d3156e8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:23.512979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace2383-8d36-41bf-a468-9dfe0d3156e8 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:23.514326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 560/1118] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:23.519379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec032d-419a-4e5f-a318-4d18e1db76b5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:23.520072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec032d-419a-4e5f-a318-4d18e1db76b5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:23.520167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec032d-419a-4e5f-a318-4d18e1db76b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:23.538520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6aec032d-419a-4e5f-a318-4d18e1db76b5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:23.539726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6aec032d-419a-4e5f-a318-4d18e1db76b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:23.602720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:23.867391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace2383-8d36-41bf-a468-9dfe0d3156e8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:23.927840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:23.965284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace2383-8d36-41bf-a468-9dfe0d3156e8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:23.999165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:23.999782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:24.000062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:24.000334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] PATH_INFO: `/v3/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:24.001712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] RBAC: Authorizing `identity:get_role(role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:24.003108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:24.004406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 561/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:23 2022] GET /identity/v3/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:24.009988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec032d-419a-4e5f-a318-4d18e1db76b5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:24.105482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec032d-419a-4e5f-a318-4d18e1db76b5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:24.125247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:24.138609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:24.139255 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:24.139533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:24.139801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] PATH_INFO: `/v3/users/e281a51fe3b3490b9e8fc76698812088` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:24.140905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] RBAC: Authorizing `identity:get_user(user_id=e281a51fe3b3490b9e8fc76698812088)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:24.142427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:24.144025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 560/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:24 2022] GET /identity/v3/users/e281a51fe3b3490b9e8fc76698812088 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:24.149698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:24.247392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085746c-20fd-4c0d-91cb-dbc27cd0d8e4 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:24.274301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:24.280554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f3510-15b3-4cbb-b850-8407ef8a7c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:24.281167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f3510-15b3-4cbb-b850-8407ef8a7c64 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:24.281445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f3510-15b3-4cbb-b850-8407ef8a7c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:24.281714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f3510-15b3-4cbb-b850-8407ef8a7c64 None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:24.282841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f3510-15b3-4cbb-b850-8407ef8a7c64 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf9e0297acb446ba93c1940556a22ec)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:24.291928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f3510-15b3-4cbb-b850-8407ef8a7c64 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:24.291928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 562/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:24 2022] GET /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:24.292387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:24.387329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6e01f-2a98-467b-a012-32379826f77c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:24.420523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460ae89-b625-4999-9194-cf73aa5ab6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:24.421155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460ae89-b625-4999-9194-cf73aa5ab6ea None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:24.421429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460ae89-b625-4999-9194-cf73aa5ab6ea None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:24.421697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460ae89-b625-4999-9194-cf73aa5ab6ea None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec/users/e281a51fe3b3490b9e8fc76698812088/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:24.423803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460ae89-b625-4999-9194-cf73aa5ab6ea None admin] RBAC: Authorizing `identity:create_grant(project_id=fdf9e0297acb446ba93c1940556a22ec, user_id=e281a51fe3b3490b9e8fc76698812088, role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:24.425205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460ae89-b625-4999-9194-cf73aa5ab6ea None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:24.485011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:37:24 2022] PUT /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec/users/e281a51fe3b3490b9e8fc76698812088/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:37:26.586997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb653-7c1e-4a9f-aec3-07fff25a5626 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:26.587577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb653-7c1e-4a9f-aec3-07fff25a5626 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:26.587577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb653-7c1e-4a9f-aec3-07fff25a5626 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:26.588848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 563/1124] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:26.594125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a3b15-ff55-4633-80db-c4136777b903 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:26.594563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a3b15-ff55-4633-80db-c4136777b903 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:26.594688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a3b15-ff55-4633-80db-c4136777b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:26.612496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-289a3b15-ff55-4633-80db-c4136777b903 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:26.613657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-289a3b15-ff55-4633-80db-c4136777b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:26.655988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:26.677549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:26.945559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cb653-7c1e-4a9f-aec3-07fff25a5626 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.044119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cb653-7c1e-4a9f-aec3-07fff25a5626 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.076391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.077005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.077282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.077551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] PATH_INFO: `/v3/roles/d4cf0419ddda4b088dd3a76f3753657e` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.078949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] RBAC: Authorizing `identity:get_role(role_id=d4cf0419ddda4b088dd3a76f3753657e)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.080323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.081616 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 564/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:26 2022] GET /identity/v3/roles/d4cf0419ddda4b088dd3a76f3753657e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:27.087278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a3b15-ff55-4633-80db-c4136777b903 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.181377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a3b15-ff55-4633-80db-c4136777b903 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.214994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.215552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.215826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.216090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] PATH_INFO: `/v3/users/e281a51fe3b3490b9e8fc76698812088` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.217186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=e281a51fe3b3490b9e8fc76698812088)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.218599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.220159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 563/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/users/e281a51fe3b3490b9e8fc76698812088 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:27.225674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.289868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:27.323022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035d8ab-bffd-4e7a-8b30-0816f4cadf49 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.355644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.356226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.356501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.356769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.420311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.421735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.480815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:27.513421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 565/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:27.519287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.564463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:27.614511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ffd30-161f-40ae-a3d2-2c0150941fa2 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.646694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240a2d-3ae2-4a0a-8c19-701f1e4bd918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.647302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240a2d-3ae2-4a0a-8c19-701f1e4bd918 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.647572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240a2d-3ae2-4a0a-8c19-701f1e4bd918 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.647837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240a2d-3ae2-4a0a-8c19-701f1e4bd918 None admin] PATH_INFO: `/v3/projects/fdf9e0297acb446ba93c1940556a22ec` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.648913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240a2d-3ae2-4a0a-8c19-701f1e4bd918 None admin] RBAC: Authorizing `identity:get_project(project_id=fdf9e0297acb446ba93c1940556a22ec)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.650890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240a2d-3ae2-4a0a-8c19-701f1e4bd918 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.652458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 564/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/projects/fdf9e0297acb446ba93c1940556a22ec => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:27.658319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:27.753085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431f996-8850-4e28-be4e-a98e5f99463a None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:27.784758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef3759-b565-42b4-9d81-1deb5094d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:27.785344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3759-b565-42b4-9d81-1deb5094d195 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:27.785616 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3759-b565-42b4-9d81-1deb5094d195 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:27.785880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3759-b565-42b4-9d81-1deb5094d195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:27.786583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3759-b565-42b4-9d81-1deb5094d195 None admin] RBAC: Adding query filter params (role.id=d4cf0419ddda4b088dd3a76f3753657e, scope.project.id=fdf9e0297acb446ba93c1940556a22ec, user.id=e281a51fe3b3490b9e8fc76698812088) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:27.786918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3759-b565-42b4-9d81-1deb5094d195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:27.788328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3759-b565-42b4-9d81-1deb5094d195 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:27.794329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 566/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:27 2022] GET /identity/v3/role_assignments?user.id=e281a51fe3b3490b9e8fc76698812088&scope.project.id=fdf9e0297acb446ba93c1940556a22ec&role.id=d4cf0419ddda4b088dd3a76f3753657e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:29.909580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899690e-1de6-40f2-8609-bca3ae189469 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:29.910120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899690e-1de6-40f2-8609-bca3ae189469 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:29.910120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899690e-1de6-40f2-8609-bca3ae189469 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:29.911467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 565/1131] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:29.917040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d39c-a042-4944-b664-7e314f3b6b2f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:29.917434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d39c-a042-4944-b664-7e314f3b6b2f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:29.917580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4d39c-a042-4944-b664-7e314f3b6b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:29.935792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b8c4d39c-a042-4944-b664-7e314f3b6b2f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:29.936888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b8c4d39c-a042-4944-b664-7e314f3b6b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:29.958962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:29.999525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 567/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:30.262184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899690e-1de6-40f2-8609-bca3ae189469 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:30.359693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899690e-1de6-40f2-8609-bca3ae189469 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:30.372788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:30.391259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60880f-7553-4716-961e-6d5e4eff6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:30.391887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60880f-7553-4716-961e-6d5e4eff6550 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:30.392159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60880f-7553-4716-961e-6d5e4eff6550 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:30.392453 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60880f-7553-4716-961e-6d5e4eff6550 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:30.393525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60880f-7553-4716-961e-6d5e4eff6550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:30.395220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60880f-7553-4716-961e-6d5e4eff6550 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:30.396731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 566/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:30.403046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d39c-a042-4944-b664-7e314f3b6b2f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:30.496158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4d39c-a042-4944-b664-7e314f3b6b2f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:30.529011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a96235-ee51-43d5-a4aa-fb81226ecda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:30.529537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96235-ee51-43d5-a4aa-fb81226ecda0 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:30.529808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96235-ee51-43d5-a4aa-fb81226ecda0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:30.530073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a96235-ee51-43d5-a4aa-fb81226ecda0 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:30.530736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a96235-ee51-43d5-a4aa-fb81226ecda0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:30.532138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a96235-ee51-43d5-a4aa-fb81226ecda0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:30.616967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 568/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:37:30 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:37:32.748659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867ab39-e79e-47ac-99f0-7a034ae1b6c8 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:32.749140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867ab39-e79e-47ac-99f0-7a034ae1b6c8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:32.749230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867ab39-e79e-47ac-99f0-7a034ae1b6c8 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:32.750512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 567/1135] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:32.755694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fa368-2104-4b8a-aa34-1ee9f484a4bf None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:32.756099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fa368-2104-4b8a-aa34-1ee9f484a4bf None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:32.756241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fa368-2104-4b8a-aa34-1ee9f484a4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:32.774758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-d25fa368-2104-4b8a-aa34-1ee9f484a4bf None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:32.775912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d25fa368-2104-4b8a-aa34-1ee9f484a4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:32.783075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:32.839858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 569/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:33.113420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867ab39-e79e-47ac-99f0-7a034ae1b6c8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:33.211718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867ab39-e79e-47ac-99f0-7a034ae1b6c8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:33.245131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d183ce-3991-4a76-9801-472954e17ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:33.245740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d183ce-3991-4a76-9801-472954e17ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:33.246013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d183ce-3991-4a76-9801-472954e17ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:33.246278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d183ce-3991-4a76-9801-472954e17ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:33.247394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d183ce-3991-4a76-9801-472954e17ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:33.248817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d183ce-3991-4a76-9801-472954e17ec1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:33.250358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 568/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:33.256005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fa368-2104-4b8a-aa34-1ee9f484a4bf None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:33.352351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fa368-2104-4b8a-aa34-1ee9f484a4bf None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:33.384919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc81ee8-be99-4f9d-af25-a4a5c9f3f540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:33.385446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc81ee8-be99-4f9d-af25-a4a5c9f3f540 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:33.385720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc81ee8-be99-4f9d-af25-a4a5c9f3f540 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:33.385992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc81ee8-be99-4f9d-af25-a4a5c9f3f540 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:33.386636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc81ee8-be99-4f9d-af25-a4a5c9f3f540 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:33.388073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc81ee8-be99-4f9d-af25-a4a5c9f3f540 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:33.468073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:33.473411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:37:33 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:35.635470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7a842-4a65-4cd5-84b3-99f98bc59d98 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:35.636004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7a842-4a65-4cd5-84b3-99f98bc59d98 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:35.636004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7a842-4a65-4cd5-84b3-99f98bc59d98 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:35.637324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 569/1139] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:35.642912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798e58-1873-4532-bcdf-0aa5a384d635 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:35.643321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798e58-1873-4532-bcdf-0aa5a384d635 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:35.643460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798e58-1873-4532-bcdf-0aa5a384d635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:35.661352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ff798e58-1873-4532-bcdf-0aa5a384d635 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:35.662509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ff798e58-1873-4532-bcdf-0aa5a384d635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:35.727063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 571/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:35.997669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7a842-4a65-4cd5-84b3-99f98bc59d98 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:36.047731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:36.095538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7a842-4a65-4cd5-84b3-99f98bc59d98 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:36.127026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:36.127630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:36.127900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:36.128164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:36.138278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:36.143030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:36.147904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:36.148810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 570/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:36.151078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798e58-1873-4532-bcdf-0aa5a384d635 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:36.244474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798e58-1873-4532-bcdf-0aa5a384d635 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:36.269863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:36.277201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:36.277788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:36.278062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:36.278326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:36.278999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:36.279295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:36.280647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:36.288165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 572/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:36.294069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:36.388924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f1a2a-1625-45f6-92d6-35e21cdd64f9 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:36.399318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:36.420779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:36.421382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:36.427636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:36.427636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] PATH_INFO: `/v3/users/92fbed806b9e4aceb2bc03892a926d97` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:36.437085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] RBAC: Authorizing `identity:get_user(user_id=92fbed806b9e4aceb2bc03892a926d97)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:36.438515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:36.440137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 571/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:36 2022] GET /identity/v3/users/92fbed806b9e4aceb2bc03892a926d97 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:36.445969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:36.540499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f603bd-39f5-40ec-8332-89c6b53e577b None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:36.572379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:36.573115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:36.573390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:36.573654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:36.626639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:36.636833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:36.638256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:36.732320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:36.738205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:36.832464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a803d50-793a-47c5-94c3-f7e3ad4af8fe None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:36.864740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e3084-3e14-469a-83ac-96480e6a66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:36.865349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e3084-3e14-469a-83ac-96480e6a66e2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:36.865626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e3084-3e14-469a-83ac-96480e6a66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:36.865894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e3084-3e14-469a-83ac-96480e6a66e2 None admin] PATH_INFO: `/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:36.867020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e3084-3e14-469a-83ac-96480e6a66e2 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf1bf01c9a641efb2ce77eaac32dc9f)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:36.868976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e3084-3e14-469a-83ac-96480e6a66e2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:36.870558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 572/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:36 2022] GET /identity/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:36.876550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:36.963474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:36.972440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e2c7d-5aa6-4284-a288-f5bbcfd30a0f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:37.004827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add91ff6-273a-4de9-8154-414185d88573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:37.005413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91ff6-273a-4de9-8154-414185d88573 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:37.005688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91ff6-273a-4de9-8154-414185d88573 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:37.005954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91ff6-273a-4de9-8154-414185d88573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:37.006662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91ff6-273a-4de9-8154-414185d88573 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=9cf1bf01c9a641efb2ce77eaac32dc9f, user.id=92fbed806b9e4aceb2bc03892a926d97) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:37.006994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91ff6-273a-4de9-8154-414185d88573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:37.008398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91ff6-273a-4de9-8154-414185d88573 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:37.014095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 574/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:36 2022] GET /identity/v3/role_assignments?user.id=92fbed806b9e4aceb2bc03892a926d97&scope.project.id=9cf1bf01c9a641efb2ce77eaac32dc9f&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:39.118737 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193494a-7466-4d91-b358-e1aeb9711eaf None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:39.119259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193494a-7466-4d91-b358-e1aeb9711eaf None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:39.119259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193494a-7466-4d91-b358-e1aeb9711eaf None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:39.120597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 573/1147] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:39.125667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41779b-58fc-4abb-a532-6042eeb30552 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:39.126116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41779b-58fc-4abb-a532-6042eeb30552 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:39.126208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41779b-58fc-4abb-a532-6042eeb30552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:39.144707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-3d41779b-58fc-4abb-a532-6042eeb30552 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:39.145870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3d41779b-58fc-4abb-a532-6042eeb30552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:39.210041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 575/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:39.476576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193494a-7466-4d91-b358-e1aeb9711eaf None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:39.511429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:39.573561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193494a-7466-4d91-b358-e1aeb9711eaf None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:39.605754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:39.606366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:39.606640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:39.606938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:39.616757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:39.622017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:39.623122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:39.624138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 574/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:39.629145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41779b-58fc-4abb-a532-6042eeb30552 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:39.711131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:39.725860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41779b-58fc-4abb-a532-6042eeb30552 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:39.758974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:39.759517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:39.759790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:39.760053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:39.760697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:39.760990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:39.762344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:39.770223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 576/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:39.776239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:39.867185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:39.873210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464695db-074c-470b-8be5-29da9f458f80 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:39.905257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:39.905860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:39.906130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:39.906394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] PATH_INFO: `/v3/users/92fbed806b9e4aceb2bc03892a926d97` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:39.907508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] RBAC: Authorizing `identity:get_user(user_id=92fbed806b9e4aceb2bc03892a926d97)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:39.908913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:39.910441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 575/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:39 2022] GET /identity/v3/users/92fbed806b9e4aceb2bc03892a926d97 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:39.916486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:40.012050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ba32-940d-4aee-a3ea-8db6bcf3ea05 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:40.043525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e9dd5-853b-415e-afc4-a16097fc9d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:40.044141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e9dd5-853b-415e-afc4-a16097fc9d25 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:40.044414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e9dd5-853b-415e-afc4-a16097fc9d25 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:40.044680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e9dd5-853b-415e-afc4-a16097fc9d25 None admin] PATH_INFO: `/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:40.045767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e9dd5-853b-415e-afc4-a16097fc9d25 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf1bf01c9a641efb2ce77eaac32dc9f)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:40.047214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e9dd5-853b-415e-afc4-a16097fc9d25 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:40.048798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 577/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:39 2022] GET /identity/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:40.054490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:40.149427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267759-0449-433e-977a-8a1a01a61c73 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:40.181714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5193a-6637-4c38-b9cf-89a2a6856212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:40.182346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5193a-6637-4c38-b9cf-89a2a6856212 None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:40.182619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5193a-6637-4c38-b9cf-89a2a6856212 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:40.182912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5193a-6637-4c38-b9cf-89a2a6856212 None admin] PATH_INFO: `/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f/users/92fbed806b9e4aceb2bc03892a926d97/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:40.184763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5193a-6637-4c38-b9cf-89a2a6856212 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cf1bf01c9a641efb2ce77eaac32dc9f, user_id=92fbed806b9e4aceb2bc03892a926d97, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:40.186165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5193a-6637-4c38-b9cf-89a2a6856212 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:40.278620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 576/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:37:40 2022] PUT /identity/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f/users/92fbed806b9e4aceb2bc03892a926d97/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:37:42.385664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300d54a-5419-4fa5-8fb6-598a77c8ba70 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:42.386195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300d54a-5419-4fa5-8fb6-598a77c8ba70 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:42.386195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300d54a-5419-4fa5-8fb6-598a77c8ba70 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:42.387567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 578/1154] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:42.392716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94fc0e-7d73-4fc4-bea6-a0432b78b4f3 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:42.393099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94fc0e-7d73-4fc4-bea6-a0432b78b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:42.393252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94fc0e-7d73-4fc4-bea6-a0432b78b4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:42.411706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fd94fc0e-7d73-4fc4-bea6-a0432b78b4f3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:42.412864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fd94fc0e-7d73-4fc4-bea6-a0432b78b4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:42.429815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:42.476728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 577/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:42.747646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300d54a-5419-4fa5-8fb6-598a77c8ba70 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:42.763774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:42.845839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300d54a-5419-4fa5-8fb6-598a77c8ba70 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:42.878013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:42.878611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:42.878909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:42.879173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:42.889244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:42.894287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:42.895389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:42.896414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 579/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:42.901914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94fc0e-7d73-4fc4-bea6-a0432b78b4f3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:42.996329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94fc0e-7d73-4fc4-bea6-a0432b78b4f3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.028624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.029208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.029482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.029745 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.030392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:43.030702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.032045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.039772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 578/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:43.045212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.116321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:43.140942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f2d5e-ae74-4272-bdcb-4cbbb438e167 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.172853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.173458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.173732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.174039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] PATH_INFO: `/v3/users/92fbed806b9e4aceb2bc03892a926d97` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.175147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] RBAC: Authorizing `identity:get_user(user_id=92fbed806b9e4aceb2bc03892a926d97)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.176561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.178083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 580/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/users/92fbed806b9e4aceb2bc03892a926d97 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:43.184563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.203642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:43.280830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae596c5f-ba41-4422-be62-1e76f2540d02 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.312547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.313132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.313407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.313670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.377171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.378588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.396079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:43.473292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:43.479624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.574901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38d39c-78ac-4390-90c8-1cd3ea102a40 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.606528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4ebc1-5a5f-4af2-b885-de0470571066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.607155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ebc1-5a5f-4af2-b885-de0470571066 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.607427 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ebc1-5a5f-4af2-b885-de0470571066 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.607692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4ebc1-5a5f-4af2-b885-de0470571066 None admin] PATH_INFO: `/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.608771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ebc1-5a5f-4af2-b885-de0470571066 None admin] RBAC: Authorizing `identity:get_project(project_id=9cf1bf01c9a641efb2ce77eaac32dc9f)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.610175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4ebc1-5a5f-4af2-b885-de0470571066 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.611774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 581/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/projects/9cf1bf01c9a641efb2ce77eaac32dc9f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:43.617673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:43.712657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362b91-7c54-450e-9e0b-e0f9282458c4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:43.728640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:43.745762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd74007-a33b-4175-be95-d50167a2c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:43.746352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74007-a33b-4175-be95-d50167a2c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:43.746629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74007-a33b-4175-be95-d50167a2c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:43.746932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74007-a33b-4175-be95-d50167a2c4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:43.753980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74007-a33b-4175-be95-d50167a2c4b1 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=9cf1bf01c9a641efb2ce77eaac32dc9f, user.id=92fbed806b9e4aceb2bc03892a926d97) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:43.753980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74007-a33b-4175-be95-d50167a2c4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:43.753980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd74007-a33b-4175-be95-d50167a2c4b1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:43.754923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 580/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:43 2022] GET /identity/v3/role_assignments?user.id=92fbed806b9e4aceb2bc03892a926d97&scope.project.id=9cf1bf01c9a641efb2ce77eaac32dc9f&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:45.889445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327a0ef-e545-44cd-9033-8fe22eaaf4db None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:45.889963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327a0ef-e545-44cd-9033-8fe22eaaf4db None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:45.889963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327a0ef-e545-44cd-9033-8fe22eaaf4db None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:45.891336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 582/1162] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:45.896702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041e56-ee2a-4a3b-8f86-3bc2666c8f7f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:45.897132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041e56-ee2a-4a3b-8f86-3bc2666c8f7f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:45.897251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1041e56-ee2a-4a3b-8f86-3bc2666c8f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:45.916176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d1041e56-ee2a-4a3b-8f86-3bc2666c8f7f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:45.917336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d1041e56-ee2a-4a3b-8f86-3bc2666c8f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:45.983031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 581/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:46.248308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327a0ef-e545-44cd-9033-8fe22eaaf4db None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:46.260728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:46.346050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327a0ef-e545-44cd-9033-8fe22eaaf4db None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:46.378072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:46.378650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:46.378952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:46.379217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:46.442222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:46.443673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:46.454453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:46.537131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 583/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:46.542914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1041e56-ee2a-4a3b-8f86-3bc2666c8f7f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:46.635726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1041e56-ee2a-4a3b-8f86-3bc2666c8f7f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:46.646768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:46.669008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ccc88-c1be-4930-963a-ba17e55a17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:46.669612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ccc88-c1be-4930-963a-ba17e55a17ab None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:46.669884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ccc88-c1be-4930-963a-ba17e55a17ab None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:46.670148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ccc88-c1be-4930-963a-ba17e55a17ab None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:46.676769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ccc88-c1be-4930-963a-ba17e55a17ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:46.678182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ccc88-c1be-4930-963a-ba17e55a17ab None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-364ccc88-c1be-4930-963a-ba17e55a17ab None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:46.691489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:46.692733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:37:46.693853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 582/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:37:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:46.698975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:46.795112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb30bd4-5830-47e3-af60-d1d6eb6551b1 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:46.805775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:46.828447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785713c-aef6-4297-bf7e-4ae6c9154dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:46.832481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785713c-aef6-4297-bf7e-4ae6c9154dfe None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:46.832481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785713c-aef6-4297-bf7e-4ae6c9154dfe None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:46.832481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785713c-aef6-4297-bf7e-4ae6c9154dfe None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:46.832481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785713c-aef6-4297-bf7e-4ae6c9154dfe None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:46.832481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785713c-aef6-4297-bf7e-4ae6c9154dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:46.832481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785713c-aef6-4297-bf7e-4ae6c9154dfe None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:46.839054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 584/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Fri Oct 28 09:37:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:48.946417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc85f-133f-4580-8672-1df1ff2c5fa9 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:48.946965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc85f-133f-4580-8672-1df1ff2c5fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:48.946965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadc85f-133f-4580-8672-1df1ff2c5fa9 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:48.948226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 583/1167] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:48.953426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8b9f6-0642-41cb-ad4b-ca9dbb92aa43 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:48.953802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8b9f6-0642-41cb-ad4b-ca9dbb92aa43 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:48.953972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8b9f6-0642-41cb-ad4b-ca9dbb92aa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:48.972175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-55a8b9f6-0642-41cb-ad4b-ca9dbb92aa43 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:48.973335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-55a8b9f6-0642-41cb-ad4b-ca9dbb92aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:49.036555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 585/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:49.305565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc85f-133f-4580-8672-1df1ff2c5fa9 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:49.402932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadc85f-133f-4580-8672-1df1ff2c5fa9 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:49.437338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be0c0-adcd-450e-a52d-04befc5975c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:49.437924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be0c0-adcd-450e-a52d-04befc5975c6 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:49.438197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be0c0-adcd-450e-a52d-04befc5975c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:49.438462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be0c0-adcd-450e-a52d-04befc5975c6 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:49.439136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8be0c0-adcd-450e-a52d-04befc5975c6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:49.440476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8be0c0-adcd-450e-a52d-04befc5975c6 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:49.513147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 584/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Fri Oct 28 09:37:49 2022] POST /identity/v3/domains => generated 267 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:51.635205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a0eb-6842-4320-8ca3-fe8abbbbc4c7 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:51.635733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a0eb-6842-4320-8ca3-fe8abbbbc4c7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:51.635733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a0eb-6842-4320-8ca3-fe8abbbbc4c7 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:51.637069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 586/1170] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:51.642502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddb72e-4099-4fcf-8f4d-6df387c40ce3 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:51.642958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddb72e-4099-4fcf-8f4d-6df387c40ce3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:51.643079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddb72e-4099-4fcf-8f4d-6df387c40ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:51.661653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-32ddb72e-4099-4fcf-8f4d-6df387c40ce3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:51.662849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-32ddb72e-4099-4fcf-8f4d-6df387c40ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:51.686220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:51.728648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 585/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:51.995296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a0eb-6842-4320-8ca3-fe8abbbbc4c7 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:52.097831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a0eb-6842-4320-8ca3-fe8abbbbc4c7 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:52.100109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:52.130842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d035ad3-2636-4a2e-b9bb-d0402773ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:52.131464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035ad3-2636-4a2e-b9bb-d0402773ce21 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:52.131737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035ad3-2636-4a2e-b9bb-d0402773ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:52.132002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035ad3-2636-4a2e-b9bb-d0402773ce21 None admin] PATH_INFO: `/v3/domains/cc0b17825a8b45529c7e2d0194b04600` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:52.142952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d035ad3-2636-4a2e-b9bb-d0402773ce21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0b17825a8b45529c7e2d0194b04600)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:52.144650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d035ad3-2636-4a2e-b9bb-d0402773ce21 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:52.146240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 587/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Fri Oct 28 09:37:51 2022] GET /identity/v3/domains/cc0b17825a8b45529c7e2d0194b04600 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:52.152314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddb72e-4099-4fcf-8f4d-6df387c40ce3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:52.247569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddb72e-4099-4fcf-8f4d-6df387c40ce3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:52.280123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c4940-1747-4374-a429-276a048e0f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:52.280720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c4940-1747-4374-a429-276a048e0f38 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:52.280995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c4940-1747-4374-a429-276a048e0f38 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:52.281261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c4940-1747-4374-a429-276a048e0f38 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:52.281905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c4940-1747-4374-a429-276a048e0f38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:52.283371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c4940-1747-4374-a429-276a048e0f38 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:52.391588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 586/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:37:52 2022] POST /identity/v3/projects => generated 361 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:54.531231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456109-85fe-44b3-9d2d-62c66564ccfb None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:54.531788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456109-85fe-44b3-9d2d-62c66564ccfb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:54.531788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456109-85fe-44b3-9d2d-62c66564ccfb None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:54.533119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 588/1174] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:54.538239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0617f-add9-476c-9263-9ea91123253e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:54.538606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0617f-add9-476c-9263-9ea91123253e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:54.538887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0617f-add9-476c-9263-9ea91123253e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:54.557648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f1f0617f-add9-476c-9263-9ea91123253e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:54.558851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f1f0617f-add9-476c-9263-9ea91123253e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:54.565891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:54.622344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 587/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:54.889099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456109-85fe-44b3-9d2d-62c66564ccfb None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:54.987254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456109-85fe-44b3-9d2d-62c66564ccfb None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:55.019870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8917b-df06-49ac-b6d6-f5e591ad59e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:55.020479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8917b-df06-49ac-b6d6-f5e591ad59e9 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:55.020756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8917b-df06-49ac-b6d6-f5e591ad59e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:55.021026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8917b-df06-49ac-b6d6-f5e591ad59e9 None admin] PATH_INFO: `/v3/domains/cc0b17825a8b45529c7e2d0194b04600` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:55.022119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8917b-df06-49ac-b6d6-f5e591ad59e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cc0b17825a8b45529c7e2d0194b04600)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:55.024099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8917b-df06-49ac-b6d6-f5e591ad59e9 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:55.025624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 589/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Fri Oct 28 09:37:54 2022] GET /identity/v3/domains/cc0b17825a8b45529c7e2d0194b04600 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:55.031252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0617f-add9-476c-9263-9ea91123253e None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:55.124272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0617f-add9-476c-9263-9ea91123253e None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:55.156941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc407ad-8205-4c56-be04-daed9166d701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:55.157479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc407ad-8205-4c56-be04-daed9166d701 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:55.157753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc407ad-8205-4c56-be04-daed9166d701 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:55.158020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc407ad-8205-4c56-be04-daed9166d701 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:55.158661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc407ad-8205-4c56-be04-daed9166d701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:55.160106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc407ad-8205-4c56-be04-daed9166d701 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:55.215063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:55.220442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 588/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:37:55 2022] POST /identity/v3/users => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:37:57.378125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057b851-c382-4fe2-b000-14edc751affc None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:57.378657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057b851-c382-4fe2-b000-14edc751affc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:57.378657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057b851-c382-4fe2-b000-14edc751affc None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:57.380000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 590/1178] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:37:57.385342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae9e7-9ee9-41d6-ad09-375334fc5a07 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:57.385763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae9e7-9ee9-41d6-ad09-375334fc5a07 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:57.385864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ae9e7-9ee9-41d6-ad09-375334fc5a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:57.405157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d90ae9e7-9ee9-41d6-ad09-375334fc5a07 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:37:57.406311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d90ae9e7-9ee9-41d6-ad09-375334fc5a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:37:57.469160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:37:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:37:57.734529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057b851-c382-4fe2-b000-14edc751affc None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:57.764999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:57.832488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057b851-c382-4fe2-b000-14edc751affc None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:57.864797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:57.865406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:57.865679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:57.865944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:57.875705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:37:57.880411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:37:57.881527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:37:57.883126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 591/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:37:57.887898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ae9e7-9ee9-41d6-ad09-375334fc5a07 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:57.980728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ae9e7-9ee9-41d6-ad09-375334fc5a07 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:58.006181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:58.014159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:58.016476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:58.016476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:58.016476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:58.016476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:58.016476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:58.017596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:58.026042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 590/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:58.031708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:58.119477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:58.127726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344130e8-263c-4456-9b0c-1498d04fe287 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:58.161273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:58.161906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:58.162207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:58.162473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] PATH_INFO: `/v3/users/60e63a806ae64fad83196f30142852aa` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:58.174954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] RBAC: Authorizing `identity:get_user(user_id=60e63a806ae64fad83196f30142852aa)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:58.176380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:58.177931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 592/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:37:58 2022] GET /identity/v3/users/60e63a806ae64fad83196f30142852aa => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:58.184280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:58.280670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fd3d1-699e-4c62-b8dd-8246c7dad97d None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:58.312814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:58.313405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:58.313678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:58.313945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:58.368348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:58.377971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:58.379421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:58.473820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:37:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:37:58.479691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:58.573896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d1843-8e14-4e91-a3e4-eb1cda39c33c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:58.606021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c791c-9136-41b2-bfc5-a227bed9d873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:58.606620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c791c-9136-41b2-bfc5-a227bed9d873 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:58.606921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c791c-9136-41b2-bfc5-a227bed9d873 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:58.607185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c791c-9136-41b2-bfc5-a227bed9d873 None admin] PATH_INFO: `/v3/projects/a5d02b06970542ddbcad52678b551df4` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:58.608261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c791c-9136-41b2-bfc5-a227bed9d873 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d02b06970542ddbcad52678b551df4)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:58.609675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c791c-9136-41b2-bfc5-a227bed9d873 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:58.611265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 593/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:37:58 2022] GET /identity/v3/projects/a5d02b06970542ddbcad52678b551df4 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:37:58.617117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:37:58.702553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:37:58.712227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff573f-2213-4ad0-9094-e7aedbfe2ae8 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:37:58.744937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ecaae-0e94-45b4-80da-0d45853c86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:37:58.745523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecaae-0e94-45b4-80da-0d45853c86b8 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:37:58.745797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecaae-0e94-45b4-80da-0d45853c86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:37:58.746064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecaae-0e94-45b4-80da-0d45853c86b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:37:58.746799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ecaae-0e94-45b4-80da-0d45853c86b8 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=a5d02b06970542ddbcad52678b551df4, user.id=60e63a806ae64fad83196f30142852aa) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:37:58.747106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ecaae-0e94-45b4-80da-0d45853c86b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:37:58.748510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ecaae-0e94-45b4-80da-0d45853c86b8 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:37:58.753658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 592/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:37:58 2022] GET /identity/v3/role_assignments?user.id=60e63a806ae64fad83196f30142852aa&scope.project.id=a5d02b06970542ddbcad52678b551df4&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:00.855616 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d4cb-7591-4744-b58c-8468efac15e5 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:00.856155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d4cb-7591-4744-b58c-8468efac15e5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:00.856155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827d4cb-7591-4744-b58c-8468efac15e5 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:00.857477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 594/1186] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:00.862510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0231-6385-4381-b11b-8c7afe7c3e17 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:00.862970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0231-6385-4381-b11b-8c7afe7c3e17 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:00.863085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a0231-6385-4381-b11b-8c7afe7c3e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:00.881508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c20a0231-6385-4381-b11b-8c7afe7c3e17 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:00.882726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c20a0231-6385-4381-b11b-8c7afe7c3e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:00.947749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 593/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:01.215399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d4cb-7591-4744-b58c-8468efac15e5 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:01.234243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:01.312387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827d4cb-7591-4744-b58c-8468efac15e5 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:01.344859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:01.345467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:01.345745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:01.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:01.356329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:01.361094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:01.362156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:38:01.363302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 595/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:01.368104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0231-6385-4381-b11b-8c7afe7c3e17 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:01.449362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:01.465279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a0231-6385-4381-b11b-8c7afe7c3e17 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:01.497300 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:01.497831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:01.498102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:01.498369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:01.499039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:01.499333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:01.500677 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:01.508776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 594/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:01.514495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:01.591741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:01.612197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b73b9f-a3cd-42ce-9d94-481795f38651 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:01.645631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:01.646241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:01.646519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:01.646821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] PATH_INFO: `/v3/users/60e63a806ae64fad83196f30142852aa` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:01.648529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=60e63a806ae64fad83196f30142852aa)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:01.649955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:01.651524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 596/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:38:01 2022] GET /identity/v3/users/60e63a806ae64fad83196f30142852aa => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:01.657102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:01.755080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0dbc2-3928-496f-80bc-35a7b0e94a05 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:01.787218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bceeef-f4ca-4161-905e-6faad4289175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:01.787830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bceeef-f4ca-4161-905e-6faad4289175 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:01.788109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bceeef-f4ca-4161-905e-6faad4289175 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:01.788965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bceeef-f4ca-4161-905e-6faad4289175 None admin] PATH_INFO: `/v3/projects/a5d02b06970542ddbcad52678b551df4` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:01.790060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bceeef-f4ca-4161-905e-6faad4289175 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d02b06970542ddbcad52678b551df4)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:01.791518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bceeef-f4ca-4161-905e-6faad4289175 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:01.793117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 595/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:38:01 2022] GET /identity/v3/projects/a5d02b06970542ddbcad52678b551df4 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:01.798954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:01.893479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba2be0-04c3-4adf-994f-ad277deea9b6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:01.926252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f054b-5f53-42a4-9b42-0ba04e99adb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:01.926912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f054b-5f53-42a4-9b42-0ba04e99adb6 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:01.927188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f054b-5f53-42a4-9b42-0ba04e99adb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:01.927455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f054b-5f53-42a4-9b42-0ba04e99adb6 None admin] PATH_INFO: `/v3/projects/a5d02b06970542ddbcad52678b551df4/users/60e63a806ae64fad83196f30142852aa/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:01.929315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f054b-5f53-42a4-9b42-0ba04e99adb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5d02b06970542ddbcad52678b551df4, user_id=60e63a806ae64fad83196f30142852aa, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:01.930756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f054b-5f53-42a4-9b42-0ba04e99adb6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:02.002317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 597/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:38:01 2022] PUT /identity/v3/projects/a5d02b06970542ddbcad52678b551df4/users/60e63a806ae64fad83196f30142852aa/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:38:04.084313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe3b1-063d-4afa-8644-cb2a63638cdd None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:04.084820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe3b1-063d-4afa-8644-cb2a63638cdd None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:04.085422 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe3b1-063d-4afa-8644-cb2a63638cdd None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:04.086705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 596/1193] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:38:04.091786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5770-1901-4cfb-aa3c-7e5d55a8ff80 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:04.092227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5770-1901-4cfb-aa3c-7e5d55a8ff80 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:04.092328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d5770-1901-4cfb-aa3c-7e5d55a8ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:04.106273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:04.111539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-dc6d5770-1901-4cfb-aa3c-7e5d55a8ff80 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:38:04.112715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-dc6d5770-1901-4cfb-aa3c-7e5d55a8ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:38:04.176604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 598/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:38:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:38:04.443150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe3b1-063d-4afa-8644-cb2a63638cdd None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:04.459372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:04.541928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe3b1-063d-4afa-8644-cb2a63638cdd None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:04.573783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:04.574384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:04.574660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:04.574968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:04.585626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:38:04.590335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:38:04.591458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:38:04.592508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 597/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:38:04.597272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5770-1901-4cfb-aa3c-7e5d55a8ff80 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:04.692653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d5770-1901-4cfb-aa3c-7e5d55a8ff80 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:04.724318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:04.724886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:04.725158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:04.725422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:04.726562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:04.726885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:04.728254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:04.730294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:04.735954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 599/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:04.742527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:04.814218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:04.837515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da9641-e299-44d0-a9ab-c8ed64e2b038 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:04.869755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:04.870357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:04.870633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:04.870930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] PATH_INFO: `/v3/users/60e63a806ae64fad83196f30142852aa` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:04.872021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] RBAC: Authorizing `identity:get_user(user_id=60e63a806ae64fad83196f30142852aa)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:04.873436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:04.875004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 598/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Fri Oct 28 09:38:04 2022] GET /identity/v3/users/60e63a806ae64fad83196f30142852aa => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:04.880583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:04.975347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db32d-cd74-437f-bdc1-942e9953be79 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:05.007074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:05.007653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:05.007926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:05.008192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:05.069095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:05.072430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:05.073851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:05.167248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 600/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:38:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:38:05.172998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:05.268039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49fb1d-eb0a-4e1a-be46-7cb03989eddb None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:05.299721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ea1b1-0b04-4e26-a36b-f803faf23eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:05.300331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea1b1-0b04-4e26-a36b-f803faf23eb2 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:05.300607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea1b1-0b04-4e26-a36b-f803faf23eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:05.300877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ea1b1-0b04-4e26-a36b-f803faf23eb2 None admin] PATH_INFO: `/v3/projects/a5d02b06970542ddbcad52678b551df4` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:05.301965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea1b1-0b04-4e26-a36b-f803faf23eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=a5d02b06970542ddbcad52678b551df4)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:05.303397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ea1b1-0b04-4e26-a36b-f803faf23eb2 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:05.305564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 599/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Fri Oct 28 09:38:05 2022] GET /identity/v3/projects/a5d02b06970542ddbcad52678b551df4 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:05.311414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:38:05.401626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:05.405203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1defd1-4bc5-4968-95db-fa847d7b9337 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:38:05.438261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2600d-80e1-4cd9-959d-788a392b3c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:38:05.438865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2600d-80e1-4cd9-959d-788a392b3c36 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:38:05.439138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2600d-80e1-4cd9-959d-788a392b3c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:38:05.439400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2600d-80e1-4cd9-959d-788a392b3c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:38:05.440099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2600d-80e1-4cd9-959d-788a392b3c36 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=a5d02b06970542ddbcad52678b551df4, user.id=60e63a806ae64fad83196f30142852aa) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:38:05.440396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2600d-80e1-4cd9-959d-788a392b3c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:38:05.441790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2600d-80e1-4cd9-959d-788a392b3c36 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:38:05.447317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 601/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:38:05 2022] GET /identity/v3/role_assignments?user.id=60e63a806ae64fad83196f30142852aa&scope.project.id=a5d02b06970542ddbcad52678b551df4&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:38:15.295722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:38:15.444809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=19 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:16.498403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769265d5-3236-4ac1-a460-ce976f7bfdc7 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:16.499161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769265d5-3236-4ac1-a460-ce976f7bfdc7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:16.499161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769265d5-3236-4ac1-a460-ce976f7bfdc7 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:16.500314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 600/1201] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:16.505446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a379-e209-40c3-83db-3d9564526f0b None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:16.512375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a379-e209-40c3-83db-3d9564526f0b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:16.512375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340a379-e209-40c3-83db-3d9564526f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:16.524080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8340a379-e209-40c3-83db-3d9564526f0b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:16.525238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8340a379-e209-40c3-83db-3d9564526f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:16.591314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:16.858579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769265d5-3236-4ac1-a460-ce976f7bfdc7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:16.958734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769265d5-3236-4ac1-a460-ce976f7bfdc7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:16.991649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:16.992861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:16.993134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:16.993397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:17.003595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:17.005008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:17.018829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:17.020022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:17.021394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:17.021394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:17.021394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:17.021394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 601/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:17.026177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340a379-e209-40c3-83db-3d9564526f0b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:17.121086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340a379-e209-40c3-83db-3d9564526f0b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:17.148479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:17.153923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a4c2f-1b99-40c0-911a-734b548c0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:17.154512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4c2f-1b99-40c0-911a-734b548c0626 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:17.154831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4c2f-1b99-40c0-911a-734b548c0626 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:17.155113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a4c2f-1b99-40c0-911a-734b548c0626 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:17.155717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a4c2f-1b99-40c0-911a-734b548c0626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:17.156010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a4c2f-1b99-40c0-911a-734b548c0626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:17.157373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a4c2f-1b99-40c0-911a-734b548c0626 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:17.168511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 603/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:17.174143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:17.224695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:17.269227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afedb5-fd09-4b2d-98fb-72ac9ceae2bb None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:17.301384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6acc80-be41-4b6d-acad-b3e93cd90381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:17.301981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6acc80-be41-4b6d-acad-b3e93cd90381 None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:17.302257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6acc80-be41-4b6d-acad-b3e93cd90381 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:17.302526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6acc80-be41-4b6d-acad-b3e93cd90381 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:17.303186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6acc80-be41-4b6d-acad-b3e93cd90381 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:17.305242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6acc80-be41-4b6d-acad-b3e93cd90381 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:17.381049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 602/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Fri Oct 28 09:39:17 2022] POST /identity/v3/users => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:39:19.520540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec43159-2822-4e84-97b2-5def63a4f43d None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:19.521244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec43159-2822-4e84-97b2-5def63a4f43d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:19.521244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec43159-2822-4e84-97b2-5def63a4f43d None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:19.522401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 604/1206] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:19.527669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1819cc-7aaa-42e9-8dc5-f5cbd4acab71 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:19.528147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1819cc-7aaa-42e9-8dc5-f5cbd4acab71 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:19.528427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1819cc-7aaa-42e9-8dc5-f5cbd4acab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:19.546794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fc1819cc-7aaa-42e9-8dc5-f5cbd4acab71 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:19.548005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fc1819cc-7aaa-42e9-8dc5-f5cbd4acab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:19.612183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 603/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 09:39:19.889405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec43159-2822-4e84-97b2-5def63a4f43d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:19.988147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec43159-2822-4e84-97b2-5def63a4f43d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.020925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.021533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.021803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.022061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.032150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:39:20.038137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:20.039274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:20.040215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 605/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:20.044093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1819cc-7aaa-42e9-8dc5-f5cbd4acab71 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:20.082229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:20.140334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1819cc-7aaa-42e9-8dc5-f5cbd4acab71 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.173898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.174499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.174792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.175059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.175700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:20.175992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:20.177345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:20.184873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 604/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:20.191334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:20.239141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:20.286800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06597241-8181-4a2c-bbf1-4e8c63bed4d7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.320098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.320716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.320985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.321244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.332968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:20.334428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:20.348617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:20.351122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:20.352242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:20.352242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:20.352242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:20.352242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 606/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:20.355578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:20.449627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:20.452330 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a28800-4fb6-4bc3-8bc4-a0ee5875fa09 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.483163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.487354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.487354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.487354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.487354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:20.487354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:20.487354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:20.498055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 605/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:20.503905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:20.600790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507640c-6fc1-4103-945c-589cb0d3e778 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.602328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:20.636525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.637180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.637456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.637723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.645034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:20.646954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:39:20.658366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:20.659480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:20.660431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 607/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:20.665657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:20.766280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362d93e-c342-46dc-9562-2628b504ae9f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.799476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.800073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.800346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.800613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.801324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:20.801621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:20.803062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:20.820864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 606/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 09:39:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:20.826871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:20.924696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa47ad-6caf-4748-88ff-700e97015982 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:20.957362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:20.957950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:20.958223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:20.958487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:20.986915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:21.023577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:21.024952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:21.117706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 608/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:39:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:39:21.123625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:21.142905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:21.218964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2ab8-5d91-4ad7-8df1-315a4b66813f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:21.251768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:21.252399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:21.252673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:21.252941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:21.264170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:21.265604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:21.279850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:21.280938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:21.281818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:21.281818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:21.281818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:21.281818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 607/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:21.286979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:21.345408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:21.382035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18603d67-a4d5-4a17-a54f-e1f3a7acd8a6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:21.416300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:21.416890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:21.417165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:21.417428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:21.418134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:21.418431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:21.419864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:21.431104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 609/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:21.436933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:21.504429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:21.535182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d2cdd-1da4-4710-92a9-03e99f67f4ff None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:21.567059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:21.567669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:21.567945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:21.568263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:21.575257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:21.576700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:39:21.588386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:21.589421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:21.590347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 608/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:21.595375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:21.692316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d97179-0104-4415-91d7-e5a63fedc237 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:21.715364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:21.726795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928acc6-ccab-4829-ad21-0498547574db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:21.727392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928acc6-ccab-4829-ad21-0498547574db None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:21.727664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928acc6-ccab-4829-ad21-0498547574db None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:21.727932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928acc6-ccab-4829-ad21-0498547574db None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:21.728687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928acc6-ccab-4829-ad21-0498547574db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:21.728983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928acc6-ccab-4829-ad21-0498547574db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:21.730412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928acc6-ccab-4829-ad21-0498547574db None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:21.741588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 610/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:21.748002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:21.846529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305c111-dc10-4766-892c-42e51a3b4967 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:21.873913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:21.879576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8eaae-e41e-42a6-b77f-abac08b54b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:21.880159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8eaae-e41e-42a6-b77f-abac08b54b43 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:21.880436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8eaae-e41e-42a6-b77f-abac08b54b43 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:21.880716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8eaae-e41e-42a6-b77f-abac08b54b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:21.881413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8eaae-e41e-42a6-b77f-abac08b54b43 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=832bcbcc10354e0d9484f76e77b7e09f) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:21.881715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8eaae-e41e-42a6-b77f-abac08b54b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:21.883799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8eaae-e41e-42a6-b77f-abac08b54b43 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:21.889289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 609/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:39:21 2022] GET /identity/v3/role_assignments?user.id=832bcbcc10354e0d9484f76e77b7e09f&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:23.997553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce33bf-4f08-48e0-a16d-765f9f99a909 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:23.998056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce33bf-4f08-48e0-a16d-765f9f99a909 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:23.998056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce33bf-4f08-48e0-a16d-765f9f99a909 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:23.999365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 611/1220] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:24.004718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fabd25-aac5-46ab-853e-5557819c5871 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:24.005099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fabd25-aac5-46ab-853e-5557819c5871 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:24.005256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fabd25-aac5-46ab-853e-5557819c5871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:24.024911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-41fabd25-aac5-46ab-853e-5557819c5871 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:24.026116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-41fabd25-aac5-46ab-853e-5557819c5871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:24.091399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 610/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:24.359894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce33bf-4f08-48e0-a16d-765f9f99a909 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:24.460213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce33bf-4f08-48e0-a16d-765f9f99a909 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:24.493510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:24.494118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:24.494398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:24.494694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:24.504653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:39:24.509911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:24.511731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:24.512924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 612/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:24.517376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fabd25-aac5-46ab-853e-5557819c5871 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:24.612217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fabd25-aac5-46ab-853e-5557819c5871 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:24.635009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:24.646194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:24.646844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:24.647109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:24.647937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:24.648640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:24.648934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:24.650287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:24.657856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 611/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:24.663791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:24.708759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:24.762928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41913170-a533-4589-97fc-2e3617a47a08 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:24.795872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:24.796681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:24.796792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:24.797036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:24.807143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:24.808612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:24.823765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:24.825609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:24.826931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:24.826931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:24.826931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:24.826931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 613/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:24.830729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:24.929796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e905c6-0dd8-42ce-80ea-7203ca4cb0a3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:24.962607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:24.963223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:24.963495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:24.963758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:24.964382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:24.964674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:24.966014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:24.977832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 612/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:24.983668 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:25.073715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:25.080162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482c65d-8fc0-449e-9c65-62314dbd3c91 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:25.113593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:25.114209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:25.114494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:25.114794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:25.121508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:25.122972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:39:25.134710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:25.135905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:25.136861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 614/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:25.141930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:25.188645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:25.240092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a66474-4375-41ca-9dee-6aeaf735ccad None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:25.273924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:25.274520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:25.274826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:25.275098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:25.275814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:25.276158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:25.277576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:25.295411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 613/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 09:39:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:25.301343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:25.399489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212897b-bb4e-467f-b7f9-b7017323dbcd None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:25.431112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:25.431722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:25.431993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:25.432256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:25.454585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:25.454585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:25.457885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:25.458979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:25.460640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:25.460640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:25.460640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:25.462809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 615/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:25.465259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:25.562013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549332b8-936c-4c14-8b06-533989daa816 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:25.564390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:25.595833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:25.596420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:25.596746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:25.597014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:25.597643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:25.597942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:25.599329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:25.610405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 614/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:25.616749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:25.626715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:25.716804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31e7b-c2bc-4605-8f88-33868b20a46e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:25.750092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:25.750781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:25.751058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:25.751323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:25.758420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:25.759885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:39:25.771250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:25.772139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:25.773687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 616/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:25.778982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:25.876572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e322e72-0a13-4b9d-9438-12d5893d26b4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:25.911942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc819d-369a-471e-8bbd-5206b6d67c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:25.912537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc819d-369a-471e-8bbd-5206b6d67c27 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:25.912808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc819d-369a-471e-8bbd-5206b6d67c27 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:25.913071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc819d-369a-471e-8bbd-5206b6d67c27 None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:25.913748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc819d-369a-471e-8bbd-5206b6d67c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:25.914042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc819d-369a-471e-8bbd-5206b6d67c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:25.915466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc819d-369a-471e-8bbd-5206b6d67c27 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:25.926840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 615/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:39:25.933592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:26.001630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:26.036029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0ae06-1b3c-4a1c-b21e-927c61adbf1f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:26.068393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd578b48-f776-478f-8dcd-0ebe4e631828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:26.069036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578b48-f776-478f-8dcd-0ebe4e631828 None admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:26.069935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578b48-f776-478f-8dcd-0ebe4e631828 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:26.070206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578b48-f776-478f-8dcd-0ebe4e631828 None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/832bcbcc10354e0d9484f76e77b7e09f/roles/e8a675fd394b45de927f3b1058683873` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:26.083800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd578b48-f776-478f-8dcd-0ebe4e631828 None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=832bcbcc10354e0d9484f76e77b7e09f, role_id=e8a675fd394b45de927f3b1058683873)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:26.085859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd578b48-f776-478f-8dcd-0ebe4e631828 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:26.157024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 617/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:39:25 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/832bcbcc10354e0d9484f76e77b7e09f/roles/e8a675fd394b45de927f3b1058683873 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:39:28.270158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d91775-f5f1-4e0f-9fc6-c342943d9d22 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:28.270801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d91775-f5f1-4e0f-9fc6-c342943d9d22 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:28.270801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d91775-f5f1-4e0f-9fc6-c342943d9d22 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:28.272061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 616/1233] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:28.277400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6f98e-9557-4e60-8bc9-31b1227af3e4 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:28.277829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6f98e-9557-4e60-8bc9-31b1227af3e4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:28.277941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6f98e-9557-4e60-8bc9-31b1227af3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:28.296409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-dbd6f98e-9557-4e60-8bc9-31b1227af3e4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:28.297552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-dbd6f98e-9557-4e60-8bc9-31b1227af3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:28.362515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 618/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:28.638622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d91775-f5f1-4e0f-9fc6-c342943d9d22 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:28.663090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:28.738542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d91775-f5f1-4e0f-9fc6-c342943d9d22 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:28.772301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:28.772922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:28.773201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:28.773462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] PATH_INFO: `/v3/roles/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:28.783243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:39:28.787957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:28.789115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:28.789960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 617/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Fri Oct 28 09:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:39:28.795077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6f98e-9557-4e60-8bc9-31b1227af3e4 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:28.841861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:28.892990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6f98e-9557-4e60-8bc9-31b1227af3e4 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:28.925526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:28.926120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:28.926392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:28.926658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:28.927329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] RBAC: Adding query filter params (name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:28.927628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:28.929483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:28.937532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 619/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Fri Oct 28 09:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:28.943412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:29.028204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:29.044093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21bed4-d641-4442-8d4e-31f334a4aace None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:29.076843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:29.077445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:29.077716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:29.077976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:29.088748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:29.090167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:29.104228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:29.105288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:29.106214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:29.106214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:29.106214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:29.106214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 618/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:29.111166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:29.207156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781289a-f080-4d8a-a95f-dcf0d0f52b36 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:29.216048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:29.239564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:29.240160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:29.240444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:29.240712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:29.241337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:29.241634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:29.243026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:29.254048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 620/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:29.260230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:29.357381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3792ffe-d77c-4e70-9418-9054dab08d2c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:29.390523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:29.391170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:29.391446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:29.391715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:29.394266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:29.399097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:29.400516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:39:29.411585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:29.413792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:29.414994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 619/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:29.418437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:29.515504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260be4d-aad1-4d5d-917e-e258899250af None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:29.547195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:29.547791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:29.548068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:29.548339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:29.549049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:29.549350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:29.550802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:29.567984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 621/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 09:39:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:29.574413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:29.672204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d947e-a0ca-4269-845b-ff0a6da76ea4 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:29.706648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:29.707259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:29.707530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:29.707829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:29.766894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:29.773143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:29.774596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:29.870289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:39:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:39:29.876187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:29.902829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:29.971514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a78356-ce0a-45f7-8e99-5da10c930a47 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:30.005384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:30.006002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:30.006296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:30.006565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:30.017018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:30.018415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:30.032606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:30.033711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:30.034852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:30.034852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:30.034852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:30.038834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 622/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:30.039979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:30.131114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:30.136785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc66f0-539d-4c38-b463-d3da53344a05 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:30.170577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:30.171224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:30.171495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:30.171763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:30.172417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:30.172750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:30.174146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:30.185044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 621/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:39:30.190931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:30.268522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:30.290032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eca066-7440-4630-9d34-7ae9bbe732a2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:30.324406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:30.325021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:30.325298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:30.325564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:30.331971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:30.333420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:39:30.344788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:30.348826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:30.349897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 623/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:30.352637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:30.452753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edbdea-63d8-4fab-8e61-914c41d47a02 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:30.485964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babf663-13e5-4428-a636-44d498f10d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:30.486551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babf663-13e5-4428-a636-44d498f10d7c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:30.486856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babf663-13e5-4428-a636-44d498f10d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:30.487122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babf663-13e5-4428-a636-44d498f10d7c None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:30.487828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babf663-13e5-4428-a636-44d498f10d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:30.488125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babf663-13e5-4428-a636-44d498f10d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:30.489522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babf663-13e5-4428-a636-44d498f10d7c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:30.501040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 622/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:30.507899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:30.604338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e432d-55f0-4fc1-81ca-9dac8c162ca5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:30.637882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99110a-fb81-4781-a387-e109983c41e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:30.638484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99110a-fb81-4781-a387-e109983c41e6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:30.638792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99110a-fb81-4781-a387-e109983c41e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:30.639062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99110a-fb81-4781-a387-e109983c41e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:30.639778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99110a-fb81-4781-a387-e109983c41e6 None admin] RBAC: Adding query filter params (role.id=e8a675fd394b45de927f3b1058683873, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=832bcbcc10354e0d9484f76e77b7e09f) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:30.640080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99110a-fb81-4781-a387-e109983c41e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:30.641502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99110a-fb81-4781-a387-e109983c41e6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:30.647901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 624/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:39:30 2022] GET /identity/v3/role_assignments?user.id=832bcbcc10354e0d9484f76e77b7e09f&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=e8a675fd394b45de927f3b1058683873 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:32.832584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecbdc-9d25-437b-b8fb-5ac786a4ff7a None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:32.833130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecbdc-9d25-437b-b8fb-5ac786a4ff7a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:32.833130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecbdc-9d25-437b-b8fb-5ac786a4ff7a None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:32.834464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 623/1247] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:32.839977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ac9d-dd73-415e-8643-7b57b4cfb267 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:32.840371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ac9d-dd73-415e-8643-7b57b4cfb267 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:32.840531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ac9d-dd73-415e-8643-7b57b4cfb267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:32.846976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:32.859769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-bac7ac9d-dd73-415e-8643-7b57b4cfb267 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:32.860951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bac7ac9d-dd73-415e-8643-7b57b4cfb267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:32.925434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 625/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:33.194357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ecbdc-9d25-437b-b8fb-5ac786a4ff7a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:33.212753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:33.293987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ecbdc-9d25-437b-b8fb-5ac786a4ff7a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:33.326429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:33.327074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:33.327345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:33.327617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:33.337839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:39:33.342632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:33.346014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:33.347115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 624/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:33.350556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7ac9d-dd73-415e-8643-7b57b4cfb267 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:33.445641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7ac9d-dd73-415e-8643-7b57b4cfb267 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:33.473375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:33.478869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:33.479469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:33.479748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:33.480017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:33.480671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:33.480970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:33.482385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:33.490539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 626/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:33.496522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:33.575358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:33.597458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0a35e-c5fe-4545-bf7c-72e2c4aee680 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:33.630000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:33.630612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:33.630913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:33.631668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:33.641701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:33.643171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:33.658112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:33.659222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:33.660295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:33.660295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:33.660295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:33.660295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 625/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:39:33.665116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:33.764275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5cd4-6723-43f3-bd34-a625b7a3c1a7 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:33.796573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:33.797175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:33.797452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:33.797726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:33.798357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:33.798654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:33.800038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:33.812012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 627/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:33.817730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:33.916744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e7fb1-4e04-45da-8594-fa86daf96093 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:33.943045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:33.951410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:33.952035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:33.952317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:33.952598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:33.959909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:33.961380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:39:33.972205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:33.984145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:33.985424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 626/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:33.986156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:34.033013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:34.075790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdc72-40cb-498d-a0aa-0a2e2a3860c3 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:34.106714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:34.107299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:34.107570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:34.107834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:34.108534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:34.108828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:34.110283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:34.127464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 628/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 09:39:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:34.133886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:34.230530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a8387-3d68-4c5a-b730-4c5f79d8f94f None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:34.264274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:34.264912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:34.265180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:34.265444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:34.318080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:34.330044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:34.331506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:34.424742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 627/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:39:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:39:34.430582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:34.527561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bca8d-90a9-4d33-aed9-fe786f9570d5 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:34.540599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:34.561324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:34.561946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:34.562251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:34.562514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:34.580324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:34.580324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:34.588717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:34.589862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:34.590970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:34.590970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:34.590970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:34.590970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 629/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:34.595735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:34.681279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:34.693413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b8c4-4659-423b-8b27-4a096bb2088c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:34.727589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:34.728181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:34.728454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:34.728745 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:34.729410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:34.729707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:34.731095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:34.741870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 628/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:34.747684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:34.851126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d5bca-4394-4a52-99e1-4ce1277887d0 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:34.884775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:34.885395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:34.885672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:34.885944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:34.892800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:34.894262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:39:34.905968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:34.906980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:34.908221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 630/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 09:39:34.913097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:35.011751 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4c1fc-fdd6-4d3c-a948-8981f876894e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:35.044272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cccbb-511e-4034-95d0-4b1e49d9ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:35.044858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cccbb-511e-4034-95d0-4b1e49d9ecaf None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:35.045128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cccbb-511e-4034-95d0-4b1e49d9ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:35.045391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cccbb-511e-4034-95d0-4b1e49d9ecaf None admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:35.046060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cccbb-511e-4034-95d0-4b1e49d9ecaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:35.046393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cccbb-511e-4034-95d0-4b1e49d9ecaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:35.047851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cccbb-511e-4034-95d0-4b1e49d9ecaf None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:35.059505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 629/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:35.065558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:35.091573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:35.161530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d6ebe-b4cb-4961-ab9e-1d837c45961d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:35.194314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846cfa4-f163-4abb-86a6-ae5766792942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:35.195448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846cfa4-f163-4abb-86a6-ae5766792942 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:35.195724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846cfa4-f163-4abb-86a6-ae5766792942 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:35.196008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846cfa4-f163-4abb-86a6-ae5766792942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:35.196711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846cfa4-f163-4abb-86a6-ae5766792942 None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=832bcbcc10354e0d9484f76e77b7e09f) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:35.197009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846cfa4-f163-4abb-86a6-ae5766792942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:35.198420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846cfa4-f163-4abb-86a6-ae5766792942 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:35.203587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 631/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:39:35 2022] GET /identity/v3/role_assignments?user.id=832bcbcc10354e0d9484f76e77b7e09f&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:37.345524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116cedc-b2bd-44ed-a9a8-8c6336f335dd None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:37.346114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116cedc-b2bd-44ed-a9a8-8c6336f335dd None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:37.346114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116cedc-b2bd-44ed-a9a8-8c6336f335dd None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:37.347440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 630/1261] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:37.352915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3e62-8b11-4516-81a5-1899d13b2e76 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:37.353349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3e62-8b11-4516-81a5-1899d13b2e76 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:37.353478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3e62-8b11-4516-81a5-1899d13b2e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:37.371303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-d90a3e62-8b11-4516-81a5-1899d13b2e76 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:37.372473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d90a3e62-8b11-4516-81a5-1899d13b2e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:37.439430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 632/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:37.705430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116cedc-b2bd-44ed-a9a8-8c6336f335dd None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:37.716568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:37.805767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116cedc-b2bd-44ed-a9a8-8c6336f335dd None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:37.838386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:37.839024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:37.839295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:37.839560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:37.849092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:39:37.853778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:37.854945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:37.856027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 631/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:37.861126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a3e62-8b11-4516-81a5-1899d13b2e76 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:37.879657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:37.958942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a3e62-8b11-4516-81a5-1899d13b2e76 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:37.992203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:37.992797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:37.993074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:37.993340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:37.993986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:37.994279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:37.995764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:38.003676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 633/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:38.010059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:38.078289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:38.110448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786c6e8-29f2-4cd7-9a2d-7363aec92e61 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:38.143445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:38.144060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:38.144335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:38.144667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:38.154387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:38.155929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:38.170484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:38.171655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:38.172780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:38.172780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:38.172780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:38.172780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 632/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:38.177557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:38.257641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:38.277411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec40d41-9eaa-4ce2-aa40-45cd3f6fb21d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:38.312009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:38.312605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:38.312881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:38.313148 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:38.313781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:38.314078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:38.315468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:38.326951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 634/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:38.332673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:38.431910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23391-44aa-4abc-b033-da09aeb298da None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:38.451332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:38.464896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:38.465509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:38.465782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:38.466045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:38.473971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:38.475438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:39:38.487265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:38.494644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:38.495822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 633/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:38.496568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:38.590505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88abacf3-1e28-4dcb-8741-feadf56a79d8 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:38.623139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:38.623732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:38.624000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:38.624264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:38.624971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:38.625268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:38.626709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:38.635837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:38.643681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 635/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 09:39:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:38.649476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:38.746004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9938676-3250-453b-97c8-f55477845d36 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:38.778049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:38.778692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:38.778979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:38.779243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:38.789727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:38.791219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:38.805322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:38.806270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:38.807392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:38.807392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:38.807392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:38.807392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 634/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:38.812112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:38.909603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d11df-6776-48b2-b316-75508a940f75 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:38.941650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:38.942241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:38.942513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:38.942807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:38.943434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:38.943729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:38.945627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:38.956326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 636/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:38.962792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:38.993533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:39.060106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd1316-a86f-4842-b86d-839d3175ea6e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:39.092278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:39.092885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:39.093158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:39.093420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:39.099843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:39.101260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:39:39.112165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:39.113199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:39.114157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 635/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:39.119603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:39.176566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:39.218426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2023a-b994-43c2-a455-f7bf3ab731bb None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:39.251082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d16a8-7381-45f9-ab79-acc0349c84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:39.251680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d16a8-7381-45f9-ab79-acc0349c84b6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:39.251952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d16a8-7381-45f9-ab79-acc0349c84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:39.252218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d16a8-7381-45f9-ab79-acc0349c84b6 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:39.252887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d16a8-7381-45f9-ab79-acc0349c84b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:39.253280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d16a8-7381-45f9-ab79-acc0349c84b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:39.254973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d16a8-7381-45f9-ab79-acc0349c84b6 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:39.267340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 637/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:39.273937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:39.362838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:39.371082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df88b8-badd-4a14-8682-1222b0f4e8d3 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:39.403028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4938c84-6219-4b08-a022-6288127cc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:39.403692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938c84-6219-4b08-a022-6288127cc84f None admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:39.403970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938c84-6219-4b08-a022-6288127cc84f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:39.404237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4938c84-6219-4b08-a022-6288127cc84f None admin] PATH_INFO: `/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/832bcbcc10354e0d9484f76e77b7e09f/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:39.406155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4938c84-6219-4b08-a022-6288127cc84f None admin] RBAC: Authorizing `identity:create_grant(project_id=c31a9818f5d646fe822d32d25199dae1, user_id=832bcbcc10354e0d9484f76e77b7e09f, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:39.407600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4938c84-6219-4b08-a022-6288127cc84f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:39.476563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 636/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Fri Oct 28 09:39:39 2022] PUT /identity/v3/projects/c31a9818f5d646fe822d32d25199dae1/users/832bcbcc10354e0d9484f76e77b7e09f/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:39:41.625501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3827-ad60-43f6-acde-9ee9f843ddb5 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:41.626078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3827-ad60-43f6-acde-9ee9f843ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:41.626078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a3827-ad60-43f6-acde-9ee9f843ddb5 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:41.627418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 638/1274] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:41.633369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd562825-1701-43ac-affd-8b1ae0513190 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:41.634002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd562825-1701-43ac-affd-8b1ae0513190 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:41.634002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd562825-1701-43ac-affd-8b1ae0513190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:41.653891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-bd562825-1701-43ac-affd-8b1ae0513190 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:41.655130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-bd562825-1701-43ac-affd-8b1ae0513190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:41.727170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 637/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:41.993712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a3827-ad60-43f6-acde-9ee9f843ddb5 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:42.094971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a3827-ad60-43f6-acde-9ee9f843ddb5 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:42.111507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:42.128141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:42.128763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:42.129038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:42.129301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:42.140220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 09:39:42.144941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:42.151215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:42.152164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 639/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Fri Oct 28 09:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:42.152907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd562825-1701-43ac-affd-8b1ae0513190 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:42.248737 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:42.276796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd562825-1701-43ac-affd-8b1ae0513190 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:42.313214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:42.314017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:42.314298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:42.314568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:42.315324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:42.315630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:42.316999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:42.326464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 638/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Fri Oct 28 09:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:42.332335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:42.431761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171f3f3-ef2e-49ca-b7bf-895a8aa9d7e6 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:42.464639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:42.465266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:42.465546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:42.465815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:42.476284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:42.478245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:42.493438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:42.494544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:42.495572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:42.495572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:42.495572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:42.495572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 640/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:42.503366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:42.607733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4d2c4-d987-4fdc-9e7d-d6cd8eed0d2e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:42.658026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:42.659822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:42.659822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:42.659822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:42.659822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:42.660164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:42.661458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:42.682604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 639/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:42.688866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:42.726087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:42.793749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05133b3-d984-466d-aff3-f807a1cac235 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:42.827792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:42.828408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:42.828679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:42.828942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:42.835655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:42.837640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 09:39:42.849816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:42.850952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:42.852486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 641/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:42.857477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:42.861310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:42.965969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fce61-8e91-4999-9198-451e4290a260 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:43.010821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:43.011422 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:43.011945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:43.012206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:43.012932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:43.013223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:43.014625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:43.032225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 640/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Fri Oct 28 09:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:43.038079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:43.139346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:43.146050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4dee2-2ffb-4c5e-aa0e-f8f113f42b7f None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:43.180356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:43.180891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:43.181167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:43.181431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:43.246752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:43.248197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:43.338204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:43.349141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 642/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Fri Oct 28 09:39:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 09:39:43.355510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:43.415673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:43.458755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5af6a8-ec90-401a-9203-e9f20fe4a641 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:43.493831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:43.494451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:43.494764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:43.495033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:43.504839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:43.511707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 09:39:43.522077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:43.523273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 09:39:43.524956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 09:39:43.524956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 09:39:43.524956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:43.524956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 641/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:43.529469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:43.634367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3cc8f-7198-4b47-967b-cb6250ce457e None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:43.667465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:43.668001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:43.668319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:43.668596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:43.669229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:43.669523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:43.670909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:43.697102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 643/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Fri Oct 28 09:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:43.698103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:43.797010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220e69e-d7d5-42a5-a4c3-c505c89996a7 None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:43.810968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:43.830634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:43.831211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:43.831486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:43.831753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:43.838216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:43.839672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 09:39:43.851797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:43.853194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: ERROR keystone.server.flask.application Oct 28 09:39:43.854108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 642/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Fri Oct 28 09:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:43.858847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:43.912498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:43.964632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9922fe-a67d-4ffa-a1d2-c53d323d171d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:44.010258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e748-d43c-4132-8af9-ddedcf061a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:44.010893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e748-d43c-4132-8af9-ddedcf061a83 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:44.011166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e748-d43c-4132-8af9-ddedcf061a83 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:44.011682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e748-d43c-4132-8af9-ddedcf061a83 None admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:44.012359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e748-d43c-4132-8af9-ddedcf061a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:44.012658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e748-d43c-4132-8af9-ddedcf061a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:44.014082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e748-d43c-4132-8af9-ddedcf061a83 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:44.026369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 644/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Fri Oct 28 09:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:44.032615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:44.132542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249647-1855-49e6-af8c-5ab720520f0e None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:44.166818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327535f8-2ff0-494b-94cf-a8fa4a7e604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:44.167419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327535f8-2ff0-494b-94cf-a8fa4a7e604c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:44.167684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327535f8-2ff0-494b-94cf-a8fa4a7e604c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:44.167950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327535f8-2ff0-494b-94cf-a8fa4a7e604c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:44.168660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327535f8-2ff0-494b-94cf-a8fa4a7e604c None admin] RBAC: Adding query filter params (role.id=48ce22383ee4418c8b558995fcc19d90, scope.project.id=c31a9818f5d646fe822d32d25199dae1, user.id=832bcbcc10354e0d9484f76e77b7e09f) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:44.168984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327535f8-2ff0-494b-94cf-a8fa4a7e604c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:44.170386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327535f8-2ff0-494b-94cf-a8fa4a7e604c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:44.176217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 643/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Fri Oct 28 09:39:44 2022] GET /identity/v3/role_assignments?user.id=832bcbcc10354e0d9484f76e77b7e09f&scope.project.id=c31a9818f5d646fe822d32d25199dae1&role.id=48ce22383ee4418c8b558995fcc19d90 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:46.316207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b2bc-f724-4214-b9ed-a37c14d5e7c2 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:46.316738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b2bc-f724-4214-b9ed-a37c14d5e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:46.316932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b2bc-f724-4214-b9ed-a37c14d5e7c2 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:46.318281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 645/1288] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:46.324081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29a09c-6d11-4dcf-b822-3652feb12a9c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:46.324538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29a09c-6d11-4dcf-b822-3652feb12a9c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:46.324631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29a09c-6d11-4dcf-b822-3652feb12a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:46.342987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ad29a09c-6d11-4dcf-b822-3652feb12a9c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:46.344141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ad29a09c-6d11-4dcf-b822-3652feb12a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:46.371944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:46.407857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 644/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:46.672526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b2bc-f724-4214-b9ed-a37c14d5e7c2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:46.772474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b2bc-f724-4214-b9ed-a37c14d5e7c2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:46.784003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:46.806847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:46.807543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:46.807858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:46.808124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:46.808695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:46.810066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:46.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:46.819767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:46.821052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 646/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:39:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:46.825697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29a09c-6d11-4dcf-b822-3652feb12a9c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:46.922611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29a09c-6d11-4dcf-b822-3652feb12a9c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:46.955077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9f2a9-e05d-4e3d-bf4d-c2d3b232429a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:46.955670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f2a9-e05d-4e3d-bf4d-c2d3b232429a None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:46.955944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f2a9-e05d-4e3d-bf4d-c2d3b232429a None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:46.956210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f2a9-e05d-4e3d-bf4d-c2d3b232429a None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:46.956824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9f2a9-e05d-4e3d-bf4d-c2d3b232429a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:46.957120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9f2a9-e05d-4e3d-bf4d-c2d3b232429a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:46.958461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9f2a9-e05d-4e3d-bf4d-c2d3b232429a None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:46.963716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 645/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 09:39:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:46.969799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:47.066751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e135ff-4a30-44e0-914d-268fa10188d2 None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:47.100168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2b456-477d-428d-8f39-0cd114d07429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:47.100761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2b456-477d-428d-8f39-0cd114d07429 None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:47.101037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2b456-477d-428d-8f39-0cd114d07429 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:47.101910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2b456-477d-428d-8f39-0cd114d07429 None admin] PATH_INFO: `/v3/services` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:47.102532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2b456-477d-428d-8f39-0cd114d07429 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:47.102857 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2b456-477d-428d-8f39-0cd114d07429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:47.104424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2b456-477d-428d-8f39-0cd114d07429 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:47.108673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 647/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 09:39:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:49.214956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4cffd-09a9-4307-a145-1bb8f7b2741f None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:49.215614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4cffd-09a9-4307-a145-1bb8f7b2741f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:49.215614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4cffd-09a9-4307-a145-1bb8f7b2741f None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:49.216849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 646/1293] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:49.222224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df2cd-f80c-423f-8b79-95a3fe8f9b15 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:49.222647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df2cd-f80c-423f-8b79-95a3fe8f9b15 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:49.222804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74df2cd-f80c-423f-8b79-95a3fe8f9b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:49.240882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b74df2cd-f80c-423f-8b79-95a3fe8f9b15 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:49.242654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b74df2cd-f80c-423f-8b79-95a3fe8f9b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:49.271393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:49.307583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 648/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:49.573080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4cffd-09a9-4307-a145-1bb8f7b2741f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:49.603018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:49.671230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4cffd-09a9-4307-a145-1bb8f7b2741f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:49.706864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1c6dc-c244-4ca5-9131-f229e36e502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:49.707460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c6dc-c244-4ca5-9131-f229e36e502f None admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:49.707741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c6dc-c244-4ca5-9131-f229e36e502f None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:49.708008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1c6dc-c244-4ca5-9131-f229e36e502f None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:49.708644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1c6dc-c244-4ca5-9131-f229e36e502f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:49.709996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1c6dc-c244-4ca5-9131-f229e36e502f None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:49.826562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 647/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Fri Oct 28 09:39:49 2022] POST /identity/v3/services => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:39:51.979699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666185e8-c47a-4183-bd8c-8b4ff00ed9d4 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:51.980218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666185e8-c47a-4183-bd8c-8b4ff00ed9d4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:51.980218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666185e8-c47a-4183-bd8c-8b4ff00ed9d4 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:51.981506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 649/1296] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:51.986762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd9f88-cd6a-47f0-b1d9-1beb70d6667a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:51.987186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd9f88-cd6a-47f0-b1d9-1beb70d6667a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:51.987287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd9f88-cd6a-47f0-b1d9-1beb70d6667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:52.005529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9fbd9f88-cd6a-47f0-b1d9-1beb70d6667a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:52.006703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9fbd9f88-cd6a-47f0-b1d9-1beb70d6667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:52.076579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 648/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:52.346862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666185e8-c47a-4183-bd8c-8b4ff00ed9d4 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:52.451278 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666185e8-c47a-4183-bd8c-8b4ff00ed9d4 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:52.485371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:52.486038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:52.486314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:52.486622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:52.487220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:52.488568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:52.497720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:52.498939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:52.500159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:52.503964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 650/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:39:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:52.505045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd9f88-cd6a-47f0-b1d9-1beb70d6667a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:52.523810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:52.606503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd9f88-cd6a-47f0-b1d9-1beb70d6667a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:52.639598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:52.640501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:52.640501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:52.640796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:52.641305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:52.641599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:52.642975 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:52.648351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 649/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 09:39:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:52.654566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:52.686202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:52.752780 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7955f3-980e-4c21-b102-83d5b8b95b3c None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:52.786094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba4560-42b7-4234-a1e8-69942b5d94db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:52.786772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4560-42b7-4234-a1e8-69942b5d94db None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:52.787054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4560-42b7-4234-a1e8-69942b5d94db None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:52.787322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba4560-42b7-4234-a1e8-69942b5d94db None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:52.788009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4560-42b7-4234-a1e8-69942b5d94db None admin] RBAC: Adding query filter params (interface=public, service_id=af8a4ecd6869485a851b60897270c0a1, region_id=RegionOne) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:52.788896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4560-42b7-4234-a1e8-69942b5d94db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:52.790340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba4560-42b7-4234-a1e8-69942b5d94db None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:52.795190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 651/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Fri Oct 28 09:39:52 2022] GET /identity/v3/endpoints?service_id=af8a4ecd6869485a851b60897270c0a1&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:39:52.800927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:52.879054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:52.896400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82a5c0-2c06-453c-9baf-3d8b63eda77c None admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:52.929570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afeaaa-01ca-4828-a9da-15a8440015d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:52.930164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afeaaa-01ca-4828-a9da-15a8440015d1 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:52.930440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afeaaa-01ca-4828-a9da-15a8440015d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:52.930733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afeaaa-01ca-4828-a9da-15a8440015d1 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:52.931326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afeaaa-01ca-4828-a9da-15a8440015d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:52.932680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afeaaa-01ca-4828-a9da-15a8440015d1 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:52.939610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 650/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Fri Oct 28 09:39:52 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:39:55.090289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f18a2-89ea-4364-a30f-28eef780282d None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:55.090833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f18a2-89ea-4364-a30f-28eef780282d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:55.090926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f18a2-89ea-4364-a30f-28eef780282d None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:55.092240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 652/1302] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:39:55.097448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f1279-d0f9-4fae-b4e0-492f58a9d0d6 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:55.097825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f1279-d0f9-4fae-b4e0-492f58a9d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:55.098150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f1279-d0f9-4fae-b4e0-492f58a9d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:55.116018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-dc4f1279-d0f9-4fae-b4e0-492f58a9d0d6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:39:55.117685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dc4f1279-d0f9-4fae-b4e0-492f58a9d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:39:55.183462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 651/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:39:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 09:39:55.450869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f18a2-89ea-4364-a30f-28eef780282d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:55.542143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:55.548489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f18a2-89ea-4364-a30f-28eef780282d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:55.582015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:55.582627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:55.582939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:55.583202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:55.583766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:55.585621 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 09:39:55.595059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 09:39:55.596193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application with Lock( Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self._enter() Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application return self.creator() Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application created_value = creator( Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: ERROR keystone.server.flask.application Oct 28 09:39:55.597120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 653/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Fri Oct 28 09:39:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 09:39:55.602743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f1279-d0f9-4fae-b4e0-492f58a9d0d6 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:55.676027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:39:55.697705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f1279-d0f9-4fae-b4e0-492f58a9d0d6 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:55.731216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd560c86-fbb5-44ba-aa6d-b7e38476ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:55.731795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd560c86-fbb5-44ba-aa6d-b7e38476ad71 None admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:55.732067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd560c86-fbb5-44ba-aa6d-b7e38476ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:55.732331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd560c86-fbb5-44ba-aa6d-b7e38476ad71 None admin] PATH_INFO: `/v3/services` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:55.732942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd560c86-fbb5-44ba-aa6d-b7e38476ad71 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:39:55.733237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd560c86-fbb5-44ba-aa6d-b7e38476ad71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:55.734588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd560c86-fbb5-44ba-aa6d-b7e38476ad71 None admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:55.739595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 652/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Fri Oct 28 09:39:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:39:55.745513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:39:55.842048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c0a1-8407-4d3c-8cdc-a407fe81994d None admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:39:55.875256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47a36f-230f-421c-9f63-38d11bf056a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:39:55.875838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47a36f-230f-421c-9f63-38d11bf056a5 None admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:39:55.876112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47a36f-230f-421c-9f63-38d11bf056a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:39:55.876380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47a36f-230f-421c-9f63-38d11bf056a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:39:55.877027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47a36f-230f-421c-9f63-38d11bf056a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:39:55.878389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47a36f-230f-421c-9f63-38d11bf056a5 None admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:39:56.007975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:39:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:40:05.736774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=30 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:40:06.002928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:16.472855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91245b6-f2d9-4bbd-a123-b5871c130693 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:16.474093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91245b6-f2d9-4bbd-a123-b5871c130693 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:16.474884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91245b6-f2d9-4bbd-a123-b5871c130693 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:16.483809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 653/1307] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:16.484845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2c8b-2a65-4433-9901-c475fd86d895 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:16.484845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2c8b-2a65-4433-9901-c475fd86d895 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:16.485610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2c8b-2a65-4433-9901-c475fd86d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:16.600460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-199b2c8b-2a65-4433-9901-c475fd86d895 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:16.603965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-199b2c8b-2a65-4433-9901-c475fd86d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:16.774777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 655/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:17.084388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca10f-6518-4453-953f-c9e25958b6d7 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:17.084733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca10f-6518-4453-953f-c9e25958b6d7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:17.084931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca10f-6518-4453-953f-c9e25958b6d7 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:17.087116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 654/1309] 10.222.0.49 () {54 vars in 964 bytes} [Fri Oct 28 09:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:17.093386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dae07a-74ae-4fbc-8b3a-bf4cebf251d4 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:17.093682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dae07a-74ae-4fbc-8b3a-bf4cebf251d4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:17.093935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dae07a-74ae-4fbc-8b3a-bf4cebf251d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:17.216694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-78dae07a-74ae-4fbc-8b3a-bf4cebf251d4 None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:17.217821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-78dae07a-74ae-4fbc-8b3a-bf4cebf251d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:17.249219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:17.324950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 656/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Fri Oct 28 09:46:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:17.334894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca10f-6518-4453-953f-c9e25958b6d7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:17.336741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-eebca10f-6518-4453-953f-c9e25958b6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:17.469606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca10f-6518-4453-953f-c9e25958b6d7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:17.557665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e72a1-2c98-4e7a-8a69-838b8643468d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:17.558332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e72a1-2c98-4e7a-8a69-838b8643468d service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:17.558656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e72a1-2c98-4e7a-8a69-838b8643468d service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:17.558930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e72a1-2c98-4e7a-8a69-838b8643468d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:17.560872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-315e72a1-2c98-4e7a-8a69-838b8643468d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:17.626527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:17.686750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e72a1-2c98-4e7a-8a69-838b8643468d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:17.688758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e72a1-2c98-4e7a-8a69-838b8643468d service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:17.710777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 655/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:20.351830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9914c3-293c-4985-a9d4-3725c0f39db4 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:20.353761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9914c3-293c-4985-a9d4-3725c0f39db4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:20.353761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9914c3-293c-4985-a9d4-3725c0f39db4 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:20.354181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 657/1312] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:20.359609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7bfb-b4fa-4d31-b4fd-aeb163b78bf2 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:20.360132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7bfb-b4fa-4d31-b4fd-aeb163b78bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:20.360132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e7bfb-b4fa-4d31-b4fd-aeb163b78bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:20.458694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-725e7bfb-b4fa-4d31-b4fd-aeb163b78bf2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:20.460454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-725e7bfb-b4fa-4d31-b4fd-aeb163b78bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:20.583850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 656/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:20.874140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9914c3-293c-4985-a9d4-3725c0f39db4 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:20.875764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7b9914c3-293c-4985-a9d4-3725c0f39db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:20.999213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9914c3-293c-4985-a9d4-3725c0f39db4 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:21.085101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:21.087200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a13dec-ccee-421e-b399-7f78dcc8f9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:21.087865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a13dec-ccee-421e-b399-7f78dcc8f9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:21.088140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a13dec-ccee-421e-b399-7f78dcc8f9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:21.088406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a13dec-ccee-421e-b399-7f78dcc8f9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:21.089996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d6a13dec-ccee-421e-b399-7f78dcc8f9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:21.204660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a13dec-ccee-421e-b399-7f78dcc8f9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:21.206063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a13dec-ccee-421e-b399-7f78dcc8f9c4 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:21.225565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 658/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:23.945767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4695c-fa97-4be6-9448-1fd86e0c81f9 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:23.946291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4695c-fa97-4be6-9448-1fd86e0c81f9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:23.946291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4695c-fa97-4be6-9448-1fd86e0c81f9 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:23.947609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 657/1315] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:23.953155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88351-ecc2-4bc8-a03e-2276927b40ca None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:23.953584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88351-ecc2-4bc8-a03e-2276927b40ca None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:23.953701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e88351-ecc2-4bc8-a03e-2276927b40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:24.021011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-18e88351-ecc2-4bc8-a03e-2276927b40ca None None] MFA Rules not processed for user `ca2aa7b49753487fba927538fa939afc`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:24.022218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-18e88351-ecc2-4bc8-a03e-2276927b40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:24.076439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:24.122606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 659/1316] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:24.422020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf14394-3b32-4146-927c-3498a09c56b4 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:24.422298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf14394-3b32-4146-927c-3498a09c56b4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:24.422571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf14394-3b32-4146-927c-3498a09c56b4 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:24.423945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 658/1317] 10.222.0.49 () {54 vars in 964 bytes} [Fri Oct 28 09:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:24.430102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041b3db-009d-40e1-9252-59a48efce589 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:24.430415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041b3db-009d-40e1-9252-59a48efce589 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:24.430722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041b3db-009d-40e1-9252-59a48efce589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:24.508182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f041b3db-009d-40e1-9252-59a48efce589 None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:24.509383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f041b3db-009d-40e1-9252-59a48efce589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:24.592674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 660/1318] 10.222.0.49 () {58 vars in 1061 bytes} [Fri Oct 28 09:46:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:24.603133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf14394-3b32-4146-927c-3498a09c56b4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:24.604671 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3cf14394-3b32-4146-927c-3498a09c56b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:24.614354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:24.710814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf14394-3b32-4146-927c-3498a09c56b4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:24.791933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195dbab-bf3a-463f-bbe1-91db3f5a64ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:24.792533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195dbab-bf3a-463f-bbe1-91db3f5a64ff service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:24.792804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195dbab-bf3a-463f-bbe1-91db3f5a64ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:24.793067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195dbab-bf3a-463f-bbe1-91db3f5a64ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:24.794640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7195dbab-bf3a-463f-bbe1-91db3f5a64ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:24.857696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:24.906043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195dbab-bf3a-463f-bbe1-91db3f5a64ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:24.907599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195dbab-bf3a-463f-bbe1-91db3f5a64ff service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:24.926799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 659/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:24 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:28.369967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e940f-a318-4575-afd6-ce18ed0cdbb7 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:28.370529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e940f-a318-4575-afd6-ce18ed0cdbb7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:28.370529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e940f-a318-4575-afd6-ce18ed0cdbb7 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:28.371970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 661/1320] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:28.377611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724767a-5b33-43a8-b6d9-88689944d461 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:28.378318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724767a-5b33-43a8-b6d9-88689944d461 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:28.378504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724767a-5b33-43a8-b6d9-88689944d461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:28.447543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0724767a-5b33-43a8-b6d9-88689944d461 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:28.448726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0724767a-5b33-43a8-b6d9-88689944d461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:28.551578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 660/1321] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:28.836808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e940f-a318-4575-afd6-ce18ed0cdbb7 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:28.840351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-815e940f-a318-4575-afd6-ce18ed0cdbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:28.893029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:28.948877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e940f-a318-4575-afd6-ce18ed0cdbb7 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:29.035305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd788476-8a6e-48bf-8b65-d4658f24cdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:29.035918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788476-8a6e-48bf-8b65-d4658f24cdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:29.036196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788476-8a6e-48bf-8b65-d4658f24cdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:29.036463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd788476-8a6e-48bf-8b65-d4658f24cdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:29.038824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fd788476-8a6e-48bf-8b65-d4658f24cdd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:29.140812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:29.156131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd788476-8a6e-48bf-8b65-d4658f24cdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:29.157585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd788476-8a6e-48bf-8b65-d4658f24cdd4 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:29.176034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 662/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:32.502875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac89ac-982f-4ac9-ab01-b54d756d7942 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:32.503438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac89ac-982f-4ac9-ab01-b54d756d7942 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:32.503438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac89ac-982f-4ac9-ab01-b54d756d7942 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:32.504754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 661/1323] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:32.511243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aed01-4915-4429-ab31-d7288872596a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:32.511732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aed01-4915-4429-ab31-d7288872596a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:32.511839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aed01-4915-4429-ab31-d7288872596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:32.583437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-968aed01-4915-4429-ab31-d7288872596a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:32.585184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-968aed01-4915-4429-ab31-d7288872596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:32.700126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 663/1324] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:32.982989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac89ac-982f-4ac9-ab01-b54d756d7942 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:32.984672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-91ac89ac-982f-4ac9-ab01-b54d756d7942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:33.005560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:33.095759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac89ac-982f-4ac9-ab01-b54d756d7942 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:33.175610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535c7cf-2aff-4660-9fbe-1b1e144517f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:33.176219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535c7cf-2aff-4660-9fbe-1b1e144517f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:33.176495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535c7cf-2aff-4660-9fbe-1b1e144517f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:33.176769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535c7cf-2aff-4660-9fbe-1b1e144517f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:33.178400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e535c7cf-2aff-4660-9fbe-1b1e144517f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:33.269512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:33.310826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535c7cf-2aff-4660-9fbe-1b1e144517f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:33.312288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535c7cf-2aff-4660-9fbe-1b1e144517f8 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:33.333258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 662/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:35.594160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7676c-cb80-48ac-b9c2-5a3dcc58b711 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:35.594663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7676c-cb80-48ac-b9c2-5a3dcc58b711 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:35.594801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7676c-cb80-48ac-b9c2-5a3dcc58b711 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:35.596072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 664/1326] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:35.601704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b189147-e5b3-405f-bd7d-b3d41087858e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:35.602175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b189147-e5b3-405f-bd7d-b3d41087858e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:35.602284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b189147-e5b3-405f-bd7d-b3d41087858e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:35.671496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2b189147-e5b3-405f-bd7d-b3d41087858e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:35.672673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2b189147-e5b3-405f-bd7d-b3d41087858e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:35.780394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 663/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:36.065714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7676c-cb80-48ac-b9c2-5a3dcc58b711 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:36.067413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f2c7676c-cb80-48ac-b9c2-5a3dcc58b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:36.132776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:36.176798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7676c-cb80-48ac-b9c2-5a3dcc58b711 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:36.255584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aed3c-4156-45e9-8f22-aba0c97a08ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:36.256500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aed3c-4156-45e9-8f22-aba0c97a08ac service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:36.256772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aed3c-4156-45e9-8f22-aba0c97a08ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:36.257036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aed3c-4156-45e9-8f22-aba0c97a08ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:36.258648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-780aed3c-4156-45e9-8f22-aba0c97a08ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:36.386572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:36.389152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780aed3c-4156-45e9-8f22-aba0c97a08ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:36.390752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780aed3c-4156-45e9-8f22-aba0c97a08ac service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:36.411807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 665/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:38.695733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc871-cddb-48ca-a929-319162743c6f None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:38.696249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc871-cddb-48ca-a929-319162743c6f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:38.696249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659dc871-cddb-48ca-a929-319162743c6f None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:38.697618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 664/1329] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:38.704233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bbbe0-5e96-4528-98fd-6f26fe6708bc None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:38.704745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bbbe0-5e96-4528-98fd-6f26fe6708bc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:38.705084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bbbe0-5e96-4528-98fd-6f26fe6708bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:38.786880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-717bbbe0-5e96-4528-98fd-6f26fe6708bc None None] MFA Rules not processed for user `ca2aa7b49753487fba927538fa939afc`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:38.788673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-717bbbe0-5e96-4528-98fd-6f26fe6708bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:38.889508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 666/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:39.182419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc871-cddb-48ca-a929-319162743c6f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:39.183998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-659dc871-cddb-48ca-a929-319162743c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:39.218770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:39.299699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659dc871-cddb-48ca-a929-319162743c6f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:39.375469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be917d-a16b-4d18-a81c-c6919ef31d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:39.376076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be917d-a16b-4d18-a81c-c6919ef31d11 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:39.376394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be917d-a16b-4d18-a81c-c6919ef31d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:39.376619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be917d-a16b-4d18-a81c-c6919ef31d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:39.378190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-87be917d-a16b-4d18-a81c-c6919ef31d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:39.463583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:39.498787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be917d-a16b-4d18-a81c-c6919ef31d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:39.500487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be917d-a16b-4d18-a81c-c6919ef31d11 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:39.521490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 665/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:42.157980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130492d-6168-40a9-9cfd-c7d25f9e76b4 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:42.158558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130492d-6168-40a9-9cfd-c7d25f9e76b4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:42.158558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130492d-6168-40a9-9cfd-c7d25f9e76b4 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:42.159932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 667/1332] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:42.166230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb45a5-7770-449a-9a58-786e86c747b9 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:42.166742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb45a5-7770-449a-9a58-786e86c747b9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:42.166842 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb45a5-7770-449a-9a58-786e86c747b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:42.236278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-18cb45a5-7770-449a-9a58-786e86c747b9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:42.237506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-18cb45a5-7770-449a-9a58-786e86c747b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:42.340254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 666/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:42.622567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130492d-6168-40a9-9cfd-c7d25f9e76b4 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:42.624113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b130492d-6168-40a9-9cfd-c7d25f9e76b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:42.695098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:42.728688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130492d-6168-40a9-9cfd-c7d25f9e76b4 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:42.801577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a39c6-2861-4ac2-a71b-ac55ce43f89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:42.802186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a39c6-2861-4ac2-a71b-ac55ce43f89b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:42.802460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a39c6-2861-4ac2-a71b-ac55ce43f89b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:42.803345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a39c6-2861-4ac2-a71b-ac55ce43f89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:42.805003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-563a39c6-2861-4ac2-a71b-ac55ce43f89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:42.912879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a39c6-2861-4ac2-a71b-ac55ce43f89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:42.914256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a39c6-2861-4ac2-a71b-ac55ce43f89b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:42.924550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:42.934502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 668/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:45.182960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbdebf-55f6-46ca-8326-a978e0f983dd None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:45.183507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbdebf-55f6-46ca-8326-a978e0f983dd None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:45.183507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbdebf-55f6-46ca-8326-a978e0f983dd None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:45.184854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 667/1335] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:45.190283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eb8f5-69a3-4db3-9c1e-dd10b33e9d8c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:45.190733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eb8f5-69a3-4db3-9c1e-dd10b33e9d8c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:45.190883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6eb8f5-69a3-4db3-9c1e-dd10b33e9d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:45.262036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4d6eb8f5-69a3-4db3-9c1e-dd10b33e9d8c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:45.263283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4d6eb8f5-69a3-4db3-9c1e-dd10b33e9d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:45.371253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 669/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:45.657506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbdebf-55f6-46ca-8326-a978e0f983dd None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:45.660193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-23bbdebf-55f6-46ca-8326-a978e0f983dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:45.704775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:45.770523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbdebf-55f6-46ca-8326-a978e0f983dd None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:45.857799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6158ac5-6aa8-47b6-b026-019a960285e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:45.858318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158ac5-6aa8-47b6-b026-019a960285e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:45.858593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158ac5-6aa8-47b6-b026-019a960285e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:45.858890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6158ac5-6aa8-47b6-b026-019a960285e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:45.860482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b6158ac5-6aa8-47b6-b026-019a960285e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:45.948683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:45.973831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158ac5-6aa8-47b6-b026-019a960285e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:45.975810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6158ac5-6aa8-47b6-b026-019a960285e8 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:45.998496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 668/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:48.970601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394555-bdb7-4fcd-904a-00652e2e4719 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:48.971163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394555-bdb7-4fcd-904a-00652e2e4719 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:48.971163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25394555-bdb7-4fcd-904a-00652e2e4719 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:48.972472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 670/1338] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:48.978078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c585d2-0a04-44a8-9844-054227ccc282 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:48.978492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c585d2-0a04-44a8-9844-054227ccc282 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:48.978601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c585d2-0a04-44a8-9844-054227ccc282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:49.045966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-08c585d2-0a04-44a8-9844-054227ccc282 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:49.047227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-08c585d2-0a04-44a8-9844-054227ccc282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:49.146743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 669/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:49.431578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25394555-bdb7-4fcd-904a-00652e2e4719 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:49.433109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-25394555-bdb7-4fcd-904a-00652e2e4719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:49.520200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:49.549670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25394555-bdb7-4fcd-904a-00652e2e4719 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:49.628062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efae9a7-a0a5-43ae-be30-e7eaebbab6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:49.628673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae9a7-a0a5-43ae-be30-e7eaebbab6fb service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:49.628952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae9a7-a0a5-43ae-be30-e7eaebbab6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:49.629220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efae9a7-a0a5-43ae-be30-e7eaebbab6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:49.631355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6efae9a7-a0a5-43ae-be30-e7eaebbab6fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:49.743586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efae9a7-a0a5-43ae-be30-e7eaebbab6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:49.745021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efae9a7-a0a5-43ae-be30-e7eaebbab6fb service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:49.762794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 671/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:54.326772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6101-a049-45d6-b247-46b8a4a84d6f None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:54.328163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6101-a049-45d6-b247-46b8a4a84d6f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:54.328733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6101-a049-45d6-b247-46b8a4a84d6f None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:54.331492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 670/1341] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:54.338424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5942ddb-5144-4e63-819f-572033082a4d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:54.340699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5942ddb-5144-4e63-819f-572033082a4d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:54.346779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5942ddb-5144-4e63-819f-572033082a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:54.350406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:54.435655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b5942ddb-5144-4e63-819f-572033082a4d None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:54.436991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b5942ddb-5144-4e63-819f-572033082a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:54.553840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:54.840237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba6101-a049-45d6-b247-46b8a4a84d6f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:54.841928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2dba6101-a049-45d6-b247-46b8a4a84d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:54.900393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:54.960845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba6101-a049-45d6-b247-46b8a4a84d6f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:55.049138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0b615-db01-460d-842f-b5ea716c9ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:55.049744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0b615-db01-460d-842f-b5ea716c9ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:55.050015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0b615-db01-460d-842f-b5ea716c9ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:55.050277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0b615-db01-460d-842f-b5ea716c9ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:55.052206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1fb0b615-db01-460d-842f-b5ea716c9ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:55.181869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:55.205106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0b615-db01-460d-842f-b5ea716c9ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:55.206631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0b615-db01-460d-842f-b5ea716c9ba8 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:55.236968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 671/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:46:58.515774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab904d-f080-491b-bcac-55e04fa2bcef None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:58.516414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab904d-f080-491b-bcac-55e04fa2bcef None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:58.516525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab904d-f080-491b-bcac-55e04fa2bcef None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:58.517890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 673/1344] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:46:58.524141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef8367-06ff-491d-ac11-0209c3dd56fc None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:58.524740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef8367-06ff-491d-ac11-0209c3dd56fc None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:58.524875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef8367-06ff-491d-ac11-0209c3dd56fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:58.595902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b6ef8367-06ff-491d-ac11-0209c3dd56fc None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:46:58.597119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b6ef8367-06ff-491d-ac11-0209c3dd56fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:58.710222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 672/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:46:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:46:59.002351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab904d-f080-491b-bcac-55e04fa2bcef None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:46:59.003990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-50ab904d-f080-491b-bcac-55e04fa2bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:59.113932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:46:59.132012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab904d-f080-491b-bcac-55e04fa2bcef None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:46:59.237901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45fd44-b7dd-4de7-99d7-c93757a925fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:46:59.238774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45fd44-b7dd-4de7-99d7-c93757a925fd service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:46:59.239054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45fd44-b7dd-4de7-99d7-c93757a925fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:46:59.239320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45fd44-b7dd-4de7-99d7-c93757a925fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:46:59.241451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-dd45fd44-b7dd-4de7-99d7-c93757a925fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:46:59.371195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45fd44-b7dd-4de7-99d7-c93757a925fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:46:59.372670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45fd44-b7dd-4de7-99d7-c93757a925fd service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:46:59.393347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 674/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:46:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:47:04.526393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45a3a-f6d3-4435-88a0-885895147210 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:04.527359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45a3a-f6d3-4435-88a0-885895147210 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:04.527649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45a3a-f6d3-4435-88a0-885895147210 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:04.528983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 673/1347] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:04.535042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f12e-756b-46cb-8b9e-4a55f4a88bea None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:04.535584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f12e-756b-46cb-8b9e-4a55f4a88bea None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:04.535584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f12e-756b-46cb-8b9e-4a55f4a88bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:04.552648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:04.611027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4176f12e-756b-46cb-8b9e-4a55f4a88bea None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:04.612237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4176f12e-756b-46cb-8b9e-4a55f4a88bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:04.731104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 675/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:05.019722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f45a3a-f6d3-4435-88a0-885895147210 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:05.021871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-96f45a3a-f6d3-4435-88a0-885895147210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:05.080767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:05.127060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f45a3a-f6d3-4435-88a0-885895147210 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:05.200660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e4a2f-4d0f-4d43-8384-f99f535fc7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:05.201267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e4a2f-4d0f-4d43-8384-f99f535fc7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:05.201536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e4a2f-4d0f-4d43-8384-f99f535fc7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:05.201801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e4a2f-4d0f-4d43-8384-f99f535fc7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:05.203440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0c9e4a2f-4d0f-4d43-8384-f99f535fc7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:05.313490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:05.317057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e4a2f-4d0f-4d43-8384-f99f535fc7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:05.319112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e4a2f-4d0f-4d43-8384-f99f535fc7a9 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:05.337870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 674/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:10.543323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e348-4cd5-43e8-8e69-9220910abea0 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:10.543845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e348-4cd5-43e8-8e69-9220910abea0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:10.543845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e348-4cd5-43e8-8e69-9220910abea0 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:10.545500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 676/1350] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:10.552013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f5de-45a7-409c-ba40-e92e6a8aea54 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:10.552492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f5de-45a7-409c-ba40-e92e6a8aea54 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:10.552673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48f5de-45a7-409c-ba40-e92e6a8aea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:10.682643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ec48f5de-45a7-409c-ba40-e92e6a8aea54 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:10.684023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ec48f5de-45a7-409c-ba40-e92e6a8aea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:10.872450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 675/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:47:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:14.729069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=59 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:15.424039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62f623-4ba5-43ed-9fd5-a6d9a15355cb None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:15.424582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62f623-4ba5-43ed-9fd5-a6d9a15355cb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:15.424854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62f623-4ba5-43ed-9fd5-a6d9a15355cb None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:15.427056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 677/1352] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:15.432742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc984-dce1-4fe6-b70a-25897c6ab76b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:15.434492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc984-dce1-4fe6-b70a-25897c6ab76b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:15.434492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc984-dce1-4fe6-b70a-25897c6ab76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:15.499217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:15.526887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-091dc984-dce1-4fe6-b70a-25897c6ab76b None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:15.528285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-091dc984-dce1-4fe6-b70a-25897c6ab76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:15.703558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 676/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:47:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:16.958956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1b15-0c58-4d40-a77f-37dfddd0c119 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:16.959482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1b15-0c58-4d40-a77f-37dfddd0c119 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:16.959482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e1b15-0c58-4d40-a77f-37dfddd0c119 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:16.961074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 678/1354] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:16.966453 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28704b0-1483-47ca-85e5-166c11081758 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:16.966945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28704b0-1483-47ca-85e5-166c11081758 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:16.967064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28704b0-1483-47ca-85e5-166c11081758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:17.047973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e28704b0-1483-47ca-85e5-166c11081758 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:17.049235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e28704b0-1483-47ca-85e5-166c11081758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:17.098183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:17.166321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 677/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:21.116969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4d223-47d3-4746-a7b9-db15597d2b12 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:21.117591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4d223-47d3-4746-a7b9-db15597d2b12 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:21.117981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4d223-47d3-4746-a7b9-db15597d2b12 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:21.127337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 679/1356] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:21.128676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5433e-4e94-433e-abd1-ce719d5ea1b5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:21.129164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5433e-4e94-433e-abd1-ce719d5ea1b5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:21.129469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5433e-4e94-433e-abd1-ce719d5ea1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:21.233327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ebd5433e-4e94-433e-abd1-ce719d5ea1b5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:21.234785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ebd5433e-4e94-433e-abd1-ce719d5ea1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:21.377520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 678/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:21.771021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa739-41fd-4cdf-aa9b-014cf3c161e5 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:21.771556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa739-41fd-4cdf-aa9b-014cf3c161e5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:21.771974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa739-41fd-4cdf-aa9b-014cf3c161e5 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:21.773518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 680/1358] 10.222.0.49 () {54 vars in 960 bytes} [Fri Oct 28 09:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:21.783950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536bf2-e613-4999-95bd-11d2099675f1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:21.784372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536bf2-e613-4999-95bd-11d2099675f1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:21.784767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab536bf2-e613-4999-95bd-11d2099675f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:21.802347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:21.868279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ab536bf2-e613-4999-95bd-11d2099675f1 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:21.870023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ab536bf2-e613-4999-95bd-11d2099675f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:22.027163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 679/1359] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:22.034269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa739-41fd-4cdf-aa9b-014cf3c161e5 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:22.037706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6b8fa739-41fd-4cdf-aa9b-014cf3c161e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:22.248085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa739-41fd-4cdf-aa9b-014cf3c161e5 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:22.340760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:22.391780 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9de6f1-2838-481e-aece-d8f6518b1e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:22.392482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de6f1-2838-481e-aece-d8f6518b1e98 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:22.392826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de6f1-2838-481e-aece-d8f6518b1e98 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:22.393160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de6f1-2838-481e-aece-d8f6518b1e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:22.394947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4f9de6f1-2838-481e-aece-d8f6518b1e98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:22.514954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9de6f1-2838-481e-aece-d8f6518b1e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:22.516860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9de6f1-2838-481e-aece-d8f6518b1e98 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:22.540702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 681/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:47:25.043723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347d99-6a5b-4588-bcd0-9958b0d42384 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:25.044279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347d99-6a5b-4588-bcd0-9958b0d42384 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:25.044279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347d99-6a5b-4588-bcd0-9958b0d42384 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:25.045743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 680/1361] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:25.051988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a71507-cf90-4f82-b7a2-aec2ad34ac00 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:25.052538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a71507-cf90-4f82-b7a2-aec2ad34ac00 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:25.052538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a71507-cf90-4f82-b7a2-aec2ad34ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:25.130902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-d4a71507-cf90-4f82-b7a2-aec2ad34ac00 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:25.132201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d4a71507-cf90-4f82-b7a2-aec2ad34ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:25.178022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:25.248365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 682/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:25.656652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56347d99-6a5b-4588-bcd0-9958b0d42384 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:25.658362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-56347d99-6a5b-4588-bcd0-9958b0d42384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:25.766428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:25.870354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56347d99-6a5b-4588-bcd0-9958b0d42384 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:26.010171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838f716-f0f7-47ed-ab1d-71ebea967757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:26.010806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f716-f0f7-47ed-ab1d-71ebea967757 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:26.011173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f716-f0f7-47ed-ab1d-71ebea967757 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:26.011438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f716-f0f7-47ed-ab1d-71ebea967757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:26.013075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8838f716-f0f7-47ed-ab1d-71ebea967757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:26.039476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:26.115814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838f716-f0f7-47ed-ab1d-71ebea967757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:26.117420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838f716-f0f7-47ed-ab1d-71ebea967757 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:26.137671 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 681/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:28.899323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04a5a7-5b14-41b7-8242-8ee252164fbd None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:28.900344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04a5a7-5b14-41b7-8242-8ee252164fbd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:28.900850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04a5a7-5b14-41b7-8242-8ee252164fbd None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:28.908156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4cf5b-62d3-4c0f-a854-e8a16323f806 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:28.909052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4cf5b-62d3-4c0f-a854-e8a16323f806 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:28.909538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4cf5b-62d3-4c0f-a854-e8a16323f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:28.914085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 683/1364] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:28 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:29.044313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-21a4cf5b-62d3-4c0f-a854-e8a16323f806 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:29.045918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-21a4cf5b-62d3-4c0f-a854-e8a16323f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:29.214662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:29.218461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 682/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:29.603965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c390426-d4ba-4ff0-affc-408d8fef7cb9 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:29.604244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c390426-d4ba-4ff0-affc-408d8fef7cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:29.604521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c390426-d4ba-4ff0-affc-408d8fef7cb9 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:29.605878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 684/1366] 10.222.0.49 () {54 vars in 960 bytes} [Fri Oct 28 09:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:29.618362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532603d4-afc6-415e-a135-e99959c5bd66 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:29.618948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532603d4-afc6-415e-a135-e99959c5bd66 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:29.619442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532603d4-afc6-415e-a135-e99959c5bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:29.741730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-532603d4-afc6-415e-a135-e99959c5bd66 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:29.743397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-532603d4-afc6-415e-a135-e99959c5bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:29.940820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 683/1367] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 09:47:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:29.966923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c390426-d4ba-4ff0-affc-408d8fef7cb9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:29.970208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5c390426-d4ba-4ff0-affc-408d8fef7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:30.208135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c390426-d4ba-4ff0-affc-408d8fef7cb9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:30.233101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:30.370055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca36176-f186-4317-93e5-131ca4f2c7d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:30.371478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca36176-f186-4317-93e5-131ca4f2c7d1 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:30.372177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca36176-f186-4317-93e5-131ca4f2c7d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:30.372849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca36176-f186-4317-93e5-131ca4f2c7d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:30.376531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bca36176-f186-4317-93e5-131ca4f2c7d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:30.511721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca36176-f186-4317-93e5-131ca4f2c7d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:30.513503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca36176-f186-4317-93e5-131ca4f2c7d1 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:30.532435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 685/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:33.281584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea28a1-4607-4de0-8ade-943e2caa1b65 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:33.282029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea28a1-4607-4de0-8ade-943e2caa1b65 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:33.282131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea28a1-4607-4de0-8ade-943e2caa1b65 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:33.289019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62b4b-ba40-4e77-a869-1801b12874e2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:33.289428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62b4b-ba40-4e77-a869-1801b12874e2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:33.289529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f62b4b-ba40-4e77-a869-1801b12874e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:33.294065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 684/1369] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:33 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:33.390387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:33.483487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-24f62b4b-ba40-4e77-a869-1801b12874e2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:33.485168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-24f62b4b-ba40-4e77-a869-1801b12874e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:33.655761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 686/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:33.952031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea28a1-4607-4de0-8ade-943e2caa1b65 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:33.953619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-afea28a1-4607-4de0-8ade-943e2caa1b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:34.010427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:34.113509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea28a1-4607-4de0-8ade-943e2caa1b65 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:34.236628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b31b5-74ef-45fe-a290-107ff28d9f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:34.237135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b31b5-74ef-45fe-a290-107ff28d9f12 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:34.237412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b31b5-74ef-45fe-a290-107ff28d9f12 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:34.237708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b31b5-74ef-45fe-a290-107ff28d9f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:34.239322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4f4b31b5-74ef-45fe-a290-107ff28d9f12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:34.245548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbabd-3a22-44ac-9c5a-ea6b3bce6104 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:34.245852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbabd-3a22-44ac-9c5a-ea6b3bce6104 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:34.246102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefbabd-3a22-44ac-9c5a-ea6b3bce6104 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:34.247639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 687/1371] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:34.249957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:34.252615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f5aa-8252-45b6-9420-54b9171598a8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:34.252905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f5aa-8252-45b6-9420-54b9171598a8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:34.253182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89f5aa-8252-45b6-9420-54b9171598a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:34.327326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ce89f5aa-8252-45b6-9420-54b9171598a8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:34.328536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ce89f5aa-8252-45b6-9420-54b9171598a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:34.345593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b31b5-74ef-45fe-a290-107ff28d9f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:34.347868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b31b5-74ef-45fe-a290-107ff28d9f12 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:34.366624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 685/1372] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:34.388610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:34.554604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 688/1373] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:34.861835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93baf5a-5864-47ff-82bb-fffe3593abf0 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:34.862187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93baf5a-5864-47ff-82bb-fffe3593abf0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:34.862385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93baf5a-5864-47ff-82bb-fffe3593abf0 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:34.864603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 686/1374] 10.222.0.49 () {54 vars in 957 bytes} [Fri Oct 28 09:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:34.869885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d841c-8579-4e19-a7f3-ff9f0df5d7ed None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:34.870305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d841c-8579-4e19-a7f3-ff9f0df5d7ed None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:34.870748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d841c-8579-4e19-a7f3-ff9f0df5d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:34.953204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-245d841c-8579-4e19-a7f3-ff9f0df5d7ed None None] MFA Rules not processed for user `6b18f309b5cb4641997b637f8f17ac87`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:34.954397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-245d841c-8579-4e19-a7f3-ff9f0df5d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:35.037939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 689/1375] 10.222.0.49 () {58 vars in 1054 bytes} [Fri Oct 28 09:47:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:35.045203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93baf5a-5864-47ff-82bb-fffe3593abf0 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:35.046777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d93baf5a-5864-47ff-82bb-fffe3593abf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:35.157059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93baf5a-5864-47ff-82bb-fffe3593abf0 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:35.195172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:35.240875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2261f4-266e-4ee4-a538-adc1598c8916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b18f309b5cb4641997b637f8f17ac87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:35.240875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2261f4-266e-4ee4-a538-adc1598c8916 service cinder] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:35.240875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2261f4-266e-4ee4-a538-adc1598c8916 service cinder] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:35.240875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2261f4-266e-4ee4-a538-adc1598c8916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:35.241771 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4e2261f4-266e-4ee4-a538-adc1598c8916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:35.369150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2261f4-266e-4ee4-a538-adc1598c8916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:35.370615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2261f4-266e-4ee4-a538-adc1598c8916 service cinder] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:35.392268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 687/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:36.734394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aa2ce-2722-4ece-93e3-613ada02c735 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:36.734918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aa2ce-2722-4ece-93e3-613ada02c735 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:36.735009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60aa2ce-2722-4ece-93e3-613ada02c735 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:36.736535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 690/1377] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:36.742250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5872-f79c-4557-a817-da419de0416e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:36.742707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5872-f79c-4557-a817-da419de0416e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:36.742865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c5872-f79c-4557-a817-da419de0416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:36.818033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-036c5872-f79c-4557-a817-da419de0416e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:36.819359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-036c5872-f79c-4557-a817-da419de0416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:36.836524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:36.933853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 688/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:37.228519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aa2ce-2722-4ece-93e3-613ada02c735 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:37.230054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a60aa2ce-2722-4ece-93e3-613ada02c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:37.291741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:37.416572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60aa2ce-2722-4ece-93e3-613ada02c735 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:37.577995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73302da7-873a-4734-b417-b4b684cee599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:37.578221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73302da7-873a-4734-b417-b4b684cee599 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:37.578319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73302da7-873a-4734-b417-b4b684cee599 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:37.578641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73302da7-873a-4734-b417-b4b684cee599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:37.580332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-73302da7-873a-4734-b417-b4b684cee599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:37.594474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:37.706470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73302da7-873a-4734-b417-b4b684cee599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:37.708179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73302da7-873a-4734-b417-b4b684cee599 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:37.730404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 691/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:40.436622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef677d1-6e51-41d5-8bec-eff2528e9872 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:40.437187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef677d1-6e51-41d5-8bec-eff2528e9872 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:40.437187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef677d1-6e51-41d5-8bec-eff2528e9872 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:40.443383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 689/1380] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:47:40.445182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb899624-2d93-4a95-b256-0236081841c4 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:40.445666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb899624-2d93-4a95-b256-0236081841c4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:40.445750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb899624-2d93-4a95-b256-0236081841c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:40.537896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-bb899624-2d93-4a95-b256-0236081841c4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:40.539279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bb899624-2d93-4a95-b256-0236081841c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:40.666824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:40.701216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 692/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:40.992651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef677d1-6e51-41d5-8bec-eff2528e9872 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:40.994156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fef677d1-6e51-41d5-8bec-eff2528e9872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:41.211506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:41.214966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef677d1-6e51-41d5-8bec-eff2528e9872 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:41.368586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c3894-ecbe-42eb-8792-57b7c23ebdf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:41.369431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3894-ecbe-42eb-8792-57b7c23ebdf0 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:41.369810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3894-ecbe-42eb-8792-57b7c23ebdf0 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:41.370204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c3894-ecbe-42eb-8792-57b7c23ebdf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:41.372422 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c42c3894-ecbe-42eb-8792-57b7c23ebdf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:41.504349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c3894-ecbe-42eb-8792-57b7c23ebdf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:41.506730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c3894-ecbe-42eb-8792-57b7c23ebdf0 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:41.532252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 690/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:44.286274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1761eb-8b16-4163-814b-400c73e7356b None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:44.286893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1761eb-8b16-4163-814b-400c73e7356b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:44.286893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1761eb-8b16-4163-814b-400c73e7356b None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:44.288604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 693/1383] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:44.298122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc750-3b77-4a2a-9074-b5251041a727 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:44.298819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc750-3b77-4a2a-9074-b5251041a727 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:44.298819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bc750-3b77-4a2a-9074-b5251041a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:44.303788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:44.401445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9b5bc750-3b77-4a2a-9074-b5251041a727 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:44.403438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9b5bc750-3b77-4a2a-9074-b5251041a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:44.589859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 691/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:44.928133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1761eb-8b16-4163-814b-400c73e7356b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:44.930213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0a1761eb-8b16-4163-814b-400c73e7356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:45.103309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1761eb-8b16-4163-814b-400c73e7356b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:45.172395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:45.237070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9b210-0ce8-4bf1-bce6-6e31706aac0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:45.239119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9b210-0ce8-4bf1-bce6-6e31706aac0f service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:45.239119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9b210-0ce8-4bf1-bce6-6e31706aac0f service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:45.239119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9b210-0ce8-4bf1-bce6-6e31706aac0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:45.240535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f8b9b210-0ce8-4bf1-bce6-6e31706aac0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:45.353529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9b210-0ce8-4bf1-bce6-6e31706aac0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:45.355667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9b210-0ce8-4bf1-bce6-6e31706aac0f service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:45.381988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 694/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:47.619734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8bba-8098-490c-99dc-e35dc6094c25 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:47.620656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8bba-8098-490c-99dc-e35dc6094c25 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:47.621140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8bba-8098-490c-99dc-e35dc6094c25 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:47.623192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 692/1386] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:47.630265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4c16b-89c1-4ec1-aa97-0c1b4f909b3a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:47.630817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4c16b-89c1-4ec1-aa97-0c1b4f909b3a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:47.631279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4c16b-89c1-4ec1-aa97-0c1b4f909b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:47.735000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-52b4c16b-89c1-4ec1-aa97-0c1b4f909b3a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:47.736408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-52b4c16b-89c1-4ec1-aa97-0c1b4f909b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:47.768867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:47.868887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 695/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:48.242628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8bba-8098-490c-99dc-e35dc6094c25 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:48.244215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-24cf8bba-8098-490c-99dc-e35dc6094c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:48.355481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:48.442475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8bba-8098-490c-99dc-e35dc6094c25 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:48.586566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2daa-0146-481e-8c17-156683c03ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:48.587294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2daa-0146-481e-8c17-156683c03ba2 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:48.587619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2daa-0146-481e-8c17-156683c03ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:48.587943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2daa-0146-481e-8c17-156683c03ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:48.589886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-888e2daa-0146-481e-8c17-156683c03ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:48.642873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:48.723672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e2daa-0146-481e-8c17-156683c03ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:48.725381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e2daa-0146-481e-8c17-156683c03ba2 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:48.747852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 693/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:51.192098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed96d-673c-4a7a-b243-7f38dad0f0a9 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:51.192898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed96d-673c-4a7a-b243-7f38dad0f0a9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:51.192898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ed96d-673c-4a7a-b243-7f38dad0f0a9 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:51.195290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 696/1389] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:47:51.204882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4a9b-3767-433c-bc48-81e9924cfb3a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:51.205502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4a9b-3767-433c-bc48-81e9924cfb3a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:51.206425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c4a9b-3767-433c-bc48-81e9924cfb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:51.313934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ee4c4a9b-3767-433c-bc48-81e9924cfb3a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:51.316417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ee4c4a9b-3767-433c-bc48-81e9924cfb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:51.441980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 694/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:51.742296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed96d-673c-4a7a-b243-7f38dad0f0a9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:51.743885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1d1ed96d-673c-4a7a-b243-7f38dad0f0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:51.904693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3264f2-ef79-4be2-a7cc-6cd979d512ee None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:51.904905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3264f2-ef79-4be2-a7cc-6cd979d512ee None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:51.905160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3264f2-ef79-4be2-a7cc-6cd979d512ee None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:51.906639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 695/1391] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:47:51.913235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e027651-856e-40cb-b9e7-8f272374ef03 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:51.913672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e027651-856e-40cb-b9e7-8f272374ef03 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:51.913950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e027651-856e-40cb-b9e7-8f272374ef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:51.929139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ed96d-673c-4a7a-b243-7f38dad0f0a9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:51.940216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:51.951996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:52.013732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7e027651-856e-40cb-b9e7-8f272374ef03 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:52.015018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7e027651-856e-40cb-b9e7-8f272374ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:52.079406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f879385-5678-49b3-92e9-6743a9c61c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:52.080034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f879385-5678-49b3-92e9-6743a9c61c73 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:52.080319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f879385-5678-49b3-92e9-6743a9c61c73 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:52.080620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f879385-5678-49b3-92e9-6743a9c61c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:52.082501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4f879385-5678-49b3-92e9-6743a9c61c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:52.156196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 696/1392] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:52.207750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f879385-5678-49b3-92e9-6743a9c61c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:52.209954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f879385-5678-49b3-92e9-6743a9c61c73 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:52.236860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 697/1393] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:52.477205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf331a-39cc-4029-b555-ed5e7085ea12 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:52.477855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf331a-39cc-4029-b555-ed5e7085ea12 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:52.477855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf331a-39cc-4029-b555-ed5e7085ea12 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:52.482152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 697/1394] 10.222.0.49 () {54 vars in 962 bytes} [Fri Oct 28 09:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:52.485429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f931-0c3b-46a2-aa25-162c50227e10 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:52.485735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f931-0c3b-46a2-aa25-162c50227e10 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:52.486007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f931-0c3b-46a2-aa25-162c50227e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:52.505726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:52.591273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b583f931-0c3b-46a2-aa25-162c50227e10 None None] MFA Rules not processed for user `ff6aed7405ec4740b3c5971d24850ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:52.592521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b583f931-0c3b-46a2-aa25-162c50227e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:52.702005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 698/1395] 10.222.0.49 () {58 vars in 1059 bytes} [Fri Oct 28 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:52.704723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf331a-39cc-4029-b555-ed5e7085ea12 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:52.707050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-51bf331a-39cc-4029-b555-ed5e7085ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:52.840491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:52.842299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf331a-39cc-4029-b555-ed5e7085ea12 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:52.925642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283fa9f-dce2-46e8-8091-1972bfd84465 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:52.926251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283fa9f-dce2-46e8-8091-1972bfd84465 service glance] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:52.926530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283fa9f-dce2-46e8-8091-1972bfd84465 service glance] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:52.926830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283fa9f-dce2-46e8-8091-1972bfd84465 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:52.928457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a283fa9f-dce2-46e8-8091-1972bfd84465 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:53.065571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283fa9f-dce2-46e8-8091-1972bfd84465 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:53.067095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283fa9f-dce2-46e8-8091-1972bfd84465 service glance] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:53.089589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 698/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:54.061582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88a4b-bceb-49ab-9530-7b7c6817f3b4 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.062149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88a4b-bceb-49ab-9530-7b7c6817f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.062447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea88a4b-bceb-49ab-9530-7b7c6817f3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.145605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7ea88a4b-bceb-49ab-9530-7b7c6817f3b4 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:54.146865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7ea88a4b-bceb-49ab-9530-7b7c6817f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:54.209643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:54.244095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 699/1397] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:54.295442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78f07-45cb-40a8-bf67-6906a8eb0a29 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.296051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78f07-45cb-40a8-bf67-6906a8eb0a29 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.296051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef78f07-45cb-40a8-bf67-6906a8eb0a29 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.297371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 699/1398] 10.222.0.49 () {54 vars in 943 bytes} [Fri Oct 28 09:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:54.304852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fece53-e255-41b4-9a05-bca573b94b7d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.305160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fece53-e255-41b4-9a05-bca573b94b7d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.305404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fece53-e255-41b4-9a05-bca573b94b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.401022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a1fece53-e255-41b4-9a05-bca573b94b7d None None] MFA Rules not processed for user `23992d468c5c427f9cac898359ee569a`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:54.402260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a1fece53-e255-41b4-9a05-bca573b94b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:54.552941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 700/1399] 10.222.0.49 () {58 vars in 1040 bytes} [Fri Oct 28 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:54.570719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78f07-45cb-40a8-bf67-6906a8eb0a29 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:54.570719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6ef78f07-45cb-40a8-bf67-6906a8eb0a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:54.620955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:54.740271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad1a1-af55-4f99-8553-da6f4c7245f6 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.740636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad1a1-af55-4f99-8553-da6f4c7245f6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.741418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfad1a1-af55-4f99-8553-da6f4c7245f6 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.748233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 701/1400] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:47:54.749838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.750129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.750403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.786950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef78f07-45cb-40a8-bf67-6906a8eb0a29 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:54.837305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:54.838173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:54.839500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:54.913961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d374c-aaa5-411b-b5ec-61bc1829e42b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:54.914872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d374c-aaa5-411b-b5ec-61bc1829e42b service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:54.915239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d374c-aaa5-411b-b5ec-61bc1829e42b service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:54.915587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d374c-aaa5-411b-b5ec-61bc1829e42b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:54.917809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-037d374c-aaa5-411b-b5ec-61bc1829e42b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:54.940909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:54.960492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 702/1401] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:47:55.028780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d374c-aaa5-411b-b5ec-61bc1829e42b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:55.030490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d374c-aaa5-411b-b5ec-61bc1829e42b service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:55.039214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 700/1402] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 09:47:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:47:55.260422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:55.261663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:55.398779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563172fb-9c25-4a18-afd1-f9e53c92e755 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:55.485114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:55.527466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9672192-7d20-44b4-8c4f-8984969b069a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:55.527992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9672192-7d20-44b4-8c4f-8984969b069a service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:55.528274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9672192-7d20-44b4-8c4f-8984969b069a service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:55.528544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9672192-7d20-44b4-8c4f-8984969b069a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:55.530141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c9672192-7d20-44b4-8c4f-8984969b069a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:55.628259 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9672192-7d20-44b4-8c4f-8984969b069a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:55.630126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9672192-7d20-44b4-8c4f-8984969b069a service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:55.648805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 703/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:47:58.204597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e42f0-d1ae-4dea-bfe4-1e96bae8937b None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:58.205721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e42f0-d1ae-4dea-bfe4-1e96bae8937b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:58.205721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e42f0-d1ae-4dea-bfe4-1e96bae8937b None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:58.213115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d163176-742b-46c6-83dd-9c20b99bdbc7 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:58.213963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d163176-742b-46c6-83dd-9c20b99bdbc7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:58.213963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d163176-742b-46c6-83dd-9c20b99bdbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:58.218314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:58.218613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 701/1404] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:47:58 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:47:58.306365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6d163176-742b-46c6-83dd-9c20b99bdbc7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:47:58.308090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6d163176-742b-46c6-83dd-9c20b99bdbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:58.439578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 704/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:47:58.742298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e42f0-d1ae-4dea-bfe4-1e96bae8937b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:47:58.744641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c55e42f0-d1ae-4dea-bfe4-1e96bae8937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:58.962764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e42f0-d1ae-4dea-bfe4-1e96bae8937b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:47:58.975250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:47:59.117344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1ad39-2160-40fa-9ede-4e064bd2f3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:47:59.117985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ad39-2160-40fa-9ede-4e064bd2f3db service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:47:59.118283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ad39-2160-40fa-9ede-4e064bd2f3db service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:47:59.118534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ad39-2160-40fa-9ede-4e064bd2f3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:47:59.120226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9ab1ad39-2160-40fa-9ede-4e064bd2f3db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:47:59.247742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1ad39-2160-40fa-9ede-4e064bd2f3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:47:59.249335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1ad39-2160-40fa-9ede-4e064bd2f3db service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:47:59.276900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 702/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:01.691706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d47d71-f1b5-473c-94e2-420b131d7eaa None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:01.692156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d47d71-f1b5-473c-94e2-420b131d7eaa None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:01.692253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d47d71-f1b5-473c-94e2-420b131d7eaa None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:01.693605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 705/1407] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:01.699547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c6514-a33b-44d2-9b44-21fcd24fa300 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:01.700444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c6514-a33b-44d2-9b44-21fcd24fa300 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:01.700721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c6514-a33b-44d2-9b44-21fcd24fa300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:01.718637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:01.787001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d66c6514-a33b-44d2-9b44-21fcd24fa300 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:01.788224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d66c6514-a33b-44d2-9b44-21fcd24fa300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:01.916942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 703/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:02.222116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d47d71-f1b5-473c-94e2-420b131d7eaa None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:02.224886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-60d47d71-f1b5-473c-94e2-420b131d7eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:02.339143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:02.446995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d47d71-f1b5-473c-94e2-420b131d7eaa None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:02.610383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0882e-ca8b-42e6-8c50-20103a219a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:02.612064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0882e-ca8b-42e6-8c50-20103a219a6e service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:02.612422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0882e-ca8b-42e6-8c50-20103a219a6e service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:02.612696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0882e-ca8b-42e6-8c50-20103a219a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:02.614401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b3e0882e-ca8b-42e6-8c50-20103a219a6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:02.690544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:02.764037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0882e-ca8b-42e6-8c50-20103a219a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:02.765676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0882e-ca8b-42e6-8c50-20103a219a6e service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:02.791056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 706/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:11.915350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=59 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:12.787817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=26 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:19.967945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc79e3-a3c0-4387-a4cb-1fc9bf9e96b0 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:19.968488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc79e3-a3c0-4387-a4cb-1fc9bf9e96b0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:19.968488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc79e3-a3c0-4387-a4cb-1fc9bf9e96b0 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:19.969734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 704/1410] 10.222.0.49 () {54 vars in 918 bytes} [Fri Oct 28 09:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:19.975329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588e39f-f5b9-4db1-9772-ff957de55a3d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:19.975819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588e39f-f5b9-4db1-9772-ff957de55a3d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:19.975937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588e39f-f5b9-4db1-9772-ff957de55a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:20.055661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4588e39f-f5b9-4db1-9772-ff957de55a3d None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:20.056887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4588e39f-f5b9-4db1-9772-ff957de55a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:20.166919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 707/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Oct 28 09:48:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:20.182372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fa1c0-fd82-4a08-b363-429dd0fa7e5b None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:20.182649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fa1c0-fd82-4a08-b363-429dd0fa7e5b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:20.182945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fa1c0-fd82-4a08-b363-429dd0fa7e5b None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:20.184293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 705/1412] 10.222.0.49 () {54 vars in 918 bytes} [Fri Oct 28 09:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:20.190448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2de2a-fcf3-4188-b394-d324dce4d49a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:20.190771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2de2a-fcf3-4188-b394-d324dce4d49a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:20.191064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2de2a-fcf3-4188-b394-d324dce4d49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:20.277168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:20.279743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-95c2de2a-fcf3-4188-b394-d324dce4d49a None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:20.280972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-95c2de2a-fcf3-4188-b394-d324dce4d49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:20.411422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 708/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Fri Oct 28 09:48:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:48:23.077934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d76a-bbf3-4b18-aebd-020117050b36 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:23.078500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d76a-bbf3-4b18-aebd-020117050b36 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:23.078500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8d76a-bbf3-4b18-aebd-020117050b36 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:23.080427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:23.086401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c34426-86b2-408b-b6b3-99b5ac37a619 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:23.086991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c34426-86b2-408b-b6b3-99b5ac37a619 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:23.086991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c34426-86b2-408b-b6b3-99b5ac37a619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:23.162969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-10c34426-86b2-408b-b6b3-99b5ac37a619 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:23.164161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-10c34426-86b2-408b-b6b3-99b5ac37a619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:23.223987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:23.277954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:23.570142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d76a-bbf3-4b18-aebd-020117050b36 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:23.571831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-80c8d76a-bbf3-4b18-aebd-020117050b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:23.740214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8d76a-bbf3-4b18-aebd-020117050b36 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:23.822182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:23.869006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575da7c8-e643-466d-9c4e-4d25eff76fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:23.869624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da7c8-e643-466d-9c4e-4d25eff76fb9 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:23.869895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da7c8-e643-466d-9c4e-4d25eff76fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:23.870158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da7c8-e643-466d-9c4e-4d25eff76fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:23.871835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-575da7c8-e643-466d-9c4e-4d25eff76fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:23.978605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575da7c8-e643-466d-9c4e-4d25eff76fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:23.980470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575da7c8-e643-466d-9c4e-4d25eff76fb9 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:24.001286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 707/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:25.178496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c3c7-ede7-4ee2-8a65-08ab29e49f2b None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:25.179089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c3c7-ede7-4ee2-8a65-08ab29e49f2b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:25.179089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159c3c7-ede7-4ee2-8a65-08ab29e49f2b None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:25.180396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:25.186992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39099df6-b70a-4e5c-ac8a-e8af5b54e3fb None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:25.187499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39099df6-b70a-4e5c-ac8a-e8af5b54e3fb None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:25.187609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39099df6-b70a-4e5c-ac8a-e8af5b54e3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:25.267779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-39099df6-b70a-4e5c-ac8a-e8af5b54e3fb None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:25.268979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-39099df6-b70a-4e5c-ac8a-e8af5b54e3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:25.296983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:25.371642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:25.565841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c3c7-ede7-4ee2-8a65-08ab29e49f2b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:25.567383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6159c3c7-ede7-4ee2-8a65-08ab29e49f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:25.720387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159c3c7-ede7-4ee2-8a65-08ab29e49f2b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:25.762025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:25.839220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89f248-7688-4078-8b74-f6c21b6ddef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:25.839747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f248-7688-4078-8b74-f6c21b6ddef5 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:25.840027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f248-7688-4078-8b74-f6c21b6ddef5 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:25.840299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89f248-7688-4078-8b74-f6c21b6ddef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:25.841904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3e89f248-7688-4078-8b74-f6c21b6ddef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:25.936807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f248-7688-4078-8b74-f6c21b6ddef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:25.939028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89f248-7688-4078-8b74-f6c21b6ddef5 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:25.956719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 711/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:27.139735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105a17-a6fc-43c9-aca4-650a0e4a26af None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:27.140384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105a17-a6fc-43c9-aca4-650a0e4a26af None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:27.140384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105a17-a6fc-43c9-aca4-650a0e4a26af None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:27.142272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:27.149053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b660-20d7-4be9-94dd-3f49d40163ff None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:27.149595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b660-20d7-4be9-94dd-3f49d40163ff None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:27.149595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128b660-20d7-4be9-94dd-3f49d40163ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:27.210467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:27.232766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1128b660-20d7-4be9-94dd-3f49d40163ff None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:27.234022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1128b660-20d7-4be9-94dd-3f49d40163ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:27.343888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:27.496522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105a17-a6fc-43c9-aca4-650a0e4a26af None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:27.497973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-52105a17-a6fc-43c9-aca4-650a0e4a26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:27.654279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105a17-a6fc-43c9-aca4-650a0e4a26af None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:27.667564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:27.779050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af395a-bd7d-43e9-aeb7-85a7c8381d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:27.779640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af395a-bd7d-43e9-aeb7-85a7c8381d68 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:27.779954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af395a-bd7d-43e9-aeb7-85a7c8381d68 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:27.780263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af395a-bd7d-43e9-aeb7-85a7c8381d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:27.782400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d8af395a-bd7d-43e9-aeb7-85a7c8381d68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:27.876351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af395a-bd7d-43e9-aeb7-85a7c8381d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:27.878238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af395a-bd7d-43e9-aeb7-85a7c8381d68 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:27.896549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:29.022216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1dab4-8b84-4d96-bd21-ea2ed8264e87 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:29.022772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1dab4-8b84-4d96-bd21-ea2ed8264e87 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:29.022772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1dab4-8b84-4d96-bd21-ea2ed8264e87 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:29.024037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:29.033483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef228d85-d8c5-48ea-88e6-612c1680f0ab None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:29.034015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef228d85-d8c5-48ea-88e6-612c1680f0ab None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:29.034015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef228d85-d8c5-48ea-88e6-612c1680f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:29.054816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:29.115654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ef228d85-d8c5-48ea-88e6-612c1680f0ab None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:29.116887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ef228d85-d8c5-48ea-88e6-612c1680f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:29.224280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:29.373528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1dab4-8b84-4d96-bd21-ea2ed8264e87 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:29.375327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6db1dab4-8b84-4d96-bd21-ea2ed8264e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:29.493855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:29.531300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1dab4-8b84-4d96-bd21-ea2ed8264e87 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:29.654403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a1871-b471-4743-a7fe-63e276e963d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:29.655045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1871-b471-4743-a7fe-63e276e963d4 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:29.655318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1871-b471-4743-a7fe-63e276e963d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:29.655647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a1871-b471-4743-a7fe-63e276e963d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:29.657871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b35a1871-b471-4743-a7fe-63e276e963d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:29.741792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:29.755958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1871-b471-4743-a7fe-63e276e963d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:29.764177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a1871-b471-4743-a7fe-63e276e963d4 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:29.777467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 714/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:30.917472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052e6b-fda7-46a5-9d1f-a70e84a6f27d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:30.918018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052e6b-fda7-46a5-9d1f-a70e84a6f27d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:30.918018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052e6b-fda7-46a5-9d1f-a70e84a6f27d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:30.919505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:30.926649 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938052f-25a3-4979-956a-ac73c6fd77df None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:30.927159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938052f-25a3-4979-956a-ac73c6fd77df None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:30.927256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938052f-25a3-4979-956a-ac73c6fd77df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:31.006022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e938052f-25a3-4979-956a-ac73c6fd77df None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:31.007170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e938052f-25a3-4979-956a-ac73c6fd77df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:31.105504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:31.260673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052e6b-fda7-46a5-9d1f-a70e84a6f27d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:31.262121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f8052e6b-fda7-46a5-9d1f-a70e84a6f27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:31.356929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:31.424582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052e6b-fda7-46a5-9d1f-a70e84a6f27d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:31.543839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6f8ec-beb7-431d-9cc4-b918f5417e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:31.544348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f8ec-beb7-431d-9cc4-b918f5417e8c service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:31.544625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f8ec-beb7-431d-9cc4-b918f5417e8c service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:31.544891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f8ec-beb7-431d-9cc4-b918f5417e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:31.546487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a0f6f8ec-beb7-431d-9cc4-b918f5417e8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:31.599806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:31.643143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6f8ec-beb7-431d-9cc4-b918f5417e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:31.644746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6f8ec-beb7-431d-9cc4-b918f5417e8c service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:31.664501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 713/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:32.821462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3551e-c3da-4693-b94d-c809e84852a8 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:32.822047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3551e-c3da-4693-b94d-c809e84852a8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:32.822047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3551e-c3da-4693-b94d-c809e84852a8 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:32.823404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:32.830640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172c788-68e4-4af9-8cff-f1ee30c18ba4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:32.831166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172c788-68e4-4af9-8cff-f1ee30c18ba4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:32.831284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172c788-68e4-4af9-8cff-f1ee30c18ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:32.911923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4172c788-68e4-4af9-8cff-f1ee30c18ba4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:32.913059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4172c788-68e4-4af9-8cff-f1ee30c18ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:33.010877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:33.164681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3551e-c3da-4693-b94d-c809e84852a8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:33.166216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d7b3551e-c3da-4693-b94d-c809e84852a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:33.218239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:33.326731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3551e-c3da-4693-b94d-c809e84852a8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:33.452990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b5ec2-7179-4b31-8365-1fd87e7acc7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:33.453581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5ec2-7179-4b31-8365-1fd87e7acc7b service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:33.453861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5ec2-7179-4b31-8365-1fd87e7acc7b service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:33.454149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b5ec2-7179-4b31-8365-1fd87e7acc7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:33.455789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0b4b5ec2-7179-4b31-8365-1fd87e7acc7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:33.463438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:33.550272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b5ec2-7179-4b31-8365-1fd87e7acc7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:33.551914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b5ec2-7179-4b31-8365-1fd87e7acc7b service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:33.570941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 717/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:34.719832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e988a7-aeba-4f76-b638-9c0ff747d192 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:34.720439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e988a7-aeba-4f76-b638-9c0ff747d192 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:34.720812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e988a7-aeba-4f76-b638-9c0ff747d192 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:34.723298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:34.730359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc433-35e3-483f-8e6d-03959a7875bd None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:34.730936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc433-35e3-483f-8e6d-03959a7875bd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:34.731049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cc433-35e3-483f-8e6d-03959a7875bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:34.813060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-700cc433-35e3-483f-8e6d-03959a7875bd None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:34.814266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-700cc433-35e3-483f-8e6d-03959a7875bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:34.894895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:34.940647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:35.164030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e988a7-aeba-4f76-b638-9c0ff747d192 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:35.165799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-94e988a7-aeba-4f76-b638-9c0ff747d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:35.185398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:35.333940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e988a7-aeba-4f76-b638-9c0ff747d192 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:35.433676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:35.464425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25501-6081-4510-95d3-381e6f679b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:35.465320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25501-6081-4510-95d3-381e6f679b24 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:35.465675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25501-6081-4510-95d3-381e6f679b24 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:35.466232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25501-6081-4510-95d3-381e6f679b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:35.468467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e6c25501-6081-4510-95d3-381e6f679b24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:35.594840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25501-6081-4510-95d3-381e6f679b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:35.597636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25501-6081-4510-95d3-381e6f679b24 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:35.632918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 716/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:36.797062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8681a1-0d77-4a46-860c-769a59659bcd None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:36.797636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8681a1-0d77-4a46-860c-769a59659bcd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:36.797636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8681a1-0d77-4a46-860c-769a59659bcd None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:36.798981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:36.806093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be031-51fb-4401-96fa-d41cebb4dd71 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:36.806610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be031-51fb-4401-96fa-d41cebb4dd71 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:36.806763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5be031-51fb-4401-96fa-d41cebb4dd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:36.885862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1b5be031-51fb-4401-96fa-d41cebb4dd71 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:36.887106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1b5be031-51fb-4401-96fa-d41cebb4dd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:36.929218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:36.986358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:37.137112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8681a1-0d77-4a46-860c-769a59659bcd None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:37.138620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-db8681a1-0d77-4a46-860c-769a59659bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:37.288242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8681a1-0d77-4a46-860c-769a59659bcd None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:37.347225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:37.405754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357025f-b3a1-4dad-8007-ecf5510726ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:37.406387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357025f-b3a1-4dad-8007-ecf5510726ae service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:37.406685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357025f-b3a1-4dad-8007-ecf5510726ae service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:37.406959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357025f-b3a1-4dad-8007-ecf5510726ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:37.408567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f357025f-b3a1-4dad-8007-ecf5510726ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:37.505483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357025f-b3a1-4dad-8007-ecf5510726ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:37.508275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357025f-b3a1-4dad-8007-ecf5510726ae service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:37.529195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 720/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:38.673926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f55cc-200b-4668-a9cc-97b5e7a6783a None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:38.674477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f55cc-200b-4668-a9cc-97b5e7a6783a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:38.674477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f55cc-200b-4668-a9cc-97b5e7a6783a None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:38.675831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:38.682185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1651cb-e902-4fe6-959a-166bf9dcfa16 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:38.682714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1651cb-e902-4fe6-959a-166bf9dcfa16 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:38.682801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1651cb-e902-4fe6-959a-166bf9dcfa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:38.768593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ea1651cb-e902-4fe6-959a-166bf9dcfa16 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:38.769862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ea1651cb-e902-4fe6-959a-166bf9dcfa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:38.771982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:38.868624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:39.019930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f55cc-200b-4668-a9cc-97b5e7a6783a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:39.021351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-854f55cc-200b-4668-a9cc-97b5e7a6783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:39.179634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f55cc-200b-4668-a9cc-97b5e7a6783a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:39.208974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:39.310401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa8a16-9665-4071-a643-c5aceef3f9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:39.311037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8a16-9665-4071-a643-c5aceef3f9ac service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:39.311311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8a16-9665-4071-a643-c5aceef3f9ac service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:39.311574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa8a16-9665-4071-a643-c5aceef3f9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:39.313674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-eaaa8a16-9665-4071-a643-c5aceef3f9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:39.414356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa8a16-9665-4071-a643-c5aceef3f9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:39.416109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa8a16-9665-4071-a643-c5aceef3f9ac service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:39.438190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 719/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:41.530987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe83bd-7b32-4769-93f5-8465b5fd1fdb None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:41.532078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe83bd-7b32-4769-93f5-8465b5fd1fdb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:41.532078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe83bd-7b32-4769-93f5-8465b5fd1fdb None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:41.533420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:41.539267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dfa85-fb02-4873-aead-0766b6e5898b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:41.539747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dfa85-fb02-4873-aead-0766b6e5898b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:41.539851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dfa85-fb02-4873-aead-0766b6e5898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:41.583079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:41.610394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-590dfa85-fb02-4873-aead-0766b6e5898b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:41.611670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-590dfa85-fb02-4873-aead-0766b6e5898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:41.720096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:42.009887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe83bd-7b32-4769-93f5-8465b5fd1fdb None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:42.011475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b3fe83bd-7b32-4769-93f5-8465b5fd1fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:42.124242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe83bd-7b32-4769-93f5-8465b5fd1fdb None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:42.159140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:42.202136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce999c-b6b3-4e02-8a08-419c1a20dabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:42.202832 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce999c-b6b3-4e02-8a08-419c1a20dabe service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:42.203113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce999c-b6b3-4e02-8a08-419c1a20dabe service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:42.203383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce999c-b6b3-4e02-8a08-419c1a20dabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:42.205007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-31ce999c-b6b3-4e02-8a08-419c1a20dabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:42.318252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce999c-b6b3-4e02-8a08-419c1a20dabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:42.319725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce999c-b6b3-4e02-8a08-419c1a20dabe service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:42.339419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 723/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:44.716371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feccbd-b526-4a2a-bd33-585ad53fd33b None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:44.716957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feccbd-b526-4a2a-bd33-585ad53fd33b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:44.716957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feccbd-b526-4a2a-bd33-585ad53fd33b None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:44.718267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:48:44.724050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efbaec-045d-465a-ac8d-4a0b13c1218c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:44.724543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efbaec-045d-465a-ac8d-4a0b13c1218c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:44.724647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efbaec-045d-465a-ac8d-4a0b13c1218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:44.795772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b3efbaec-045d-465a-ac8d-4a0b13c1218c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:44.797623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b3efbaec-045d-465a-ac8d-4a0b13c1218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:44.811241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:44.899707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:45.182683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feccbd-b526-4a2a-bd33-585ad53fd33b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:45.184222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-21feccbd-b526-4a2a-bd33-585ad53fd33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:45.290208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feccbd-b526-4a2a-bd33-585ad53fd33b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:45.304074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:45.368225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fc900-d4c3-4a6f-99ac-03d683eeb005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:45.368837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc900-d4c3-4a6f-99ac-03d683eeb005 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:45.369113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc900-d4c3-4a6f-99ac-03d683eeb005 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:45.369382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fc900-d4c3-4a6f-99ac-03d683eeb005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:45.371022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f51fc900-d4c3-4a6f-99ac-03d683eeb005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:45.483149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fc900-d4c3-4a6f-99ac-03d683eeb005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:45.485076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fc900-d4c3-4a6f-99ac-03d683eeb005 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:45.504343 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 722/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:48.091829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69b4a9-0118-4a99-87de-bb4fd1095322 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:48.092498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69b4a9-0118-4a99-87de-bb4fd1095322 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:48.092498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69b4a9-0118-4a99-87de-bb4fd1095322 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:48.094294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:48.100107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b6a7a-a937-4487-a07e-80767e30958d None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:48.100605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b6a7a-a937-4487-a07e-80767e30958d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:48.100711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b6a7a-a937-4487-a07e-80767e30958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:48.149353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:48.168156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-726b6a7a-a937-4487-a07e-80767e30958d None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:48.169652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-726b6a7a-a937-4487-a07e-80767e30958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:48.266973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:48.550216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69b4a9-0118-4a99-87de-bb4fd1095322 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:48.551840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4c69b4a9-0118-4a99-87de-bb4fd1095322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:48.654820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69b4a9-0118-4a99-87de-bb4fd1095322 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:48.703432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:48.739714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02a60e-459e-4f33-9241-ee33cbe15328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:48.740319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02a60e-459e-4f33-9241-ee33cbe15328 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:48.740593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02a60e-459e-4f33-9241-ee33cbe15328 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:48.740864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02a60e-459e-4f33-9241-ee33cbe15328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:48.742472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8e02a60e-459e-4f33-9241-ee33cbe15328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:48.857138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02a60e-459e-4f33-9241-ee33cbe15328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:48.858808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02a60e-459e-4f33-9241-ee33cbe15328 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:48.878380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 726/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:51.225403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe26fe-7b0f-4757-a9a9-25a6509b239a None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:51.225992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe26fe-7b0f-4757-a9a9-25a6509b239a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:51.225992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe26fe-7b0f-4757-a9a9-25a6509b239a None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:51.227342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:51.232901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f9e7f-9d8f-4789-a212-434801f8520d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:51.233403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f9e7f-9d8f-4789-a212-434801f8520d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:51.233563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f9e7f-9d8f-4789-a212-434801f8520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:51.308924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-051f9e7f-9d8f-4789-a212-434801f8520d None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:51.310163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-051f9e7f-9d8f-4789-a212-434801f8520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:51.334341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:51.420046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:51.728170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe26fe-7b0f-4757-a9a9-25a6509b239a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:51.729732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e8fe26fe-7b0f-4757-a9a9-25a6509b239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:51.844433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe26fe-7b0f-4757-a9a9-25a6509b239a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:51.866340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:51.924641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372374-10bb-40f2-a709-227b8cece186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:51.925920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372374-10bb-40f2-a709-227b8cece186 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:51.926205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372374-10bb-40f2-a709-227b8cece186 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:51.926479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372374-10bb-40f2-a709-227b8cece186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:51.928146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-40372374-10bb-40f2-a709-227b8cece186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:52.052721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372374-10bb-40f2-a709-227b8cece186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:52.054181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372374-10bb-40f2-a709-227b8cece186 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:52.074456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 725/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:54.393025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083300-09fe-464f-9517-459707be2c4e None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:54.393650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083300-09fe-464f-9517-459707be2c4e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:54.393650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6083300-09fe-464f-9517-459707be2c4e None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:54.394937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:54.400689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d2891-0762-4b2a-b995-402c3d661968 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:54.401175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d2891-0762-4b2a-b995-402c3d661968 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:54.401310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d2891-0762-4b2a-b995-402c3d661968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:54.469467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:54.472426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-212d2891-0762-4b2a-b995-402c3d661968 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:54.473772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-212d2891-0762-4b2a-b995-402c3d661968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:54.581536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:48:54.873875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6083300-09fe-464f-9517-459707be2c4e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:54.875942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c6083300-09fe-464f-9517-459707be2c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:55.005857 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6083300-09fe-464f-9517-459707be2c4e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:55.068307 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:55.095317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3bde3-6bf4-4fd7-b997-212d8a4a81de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:55.095920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3bde3-6bf4-4fd7-b997-212d8a4a81de service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:55.096191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3bde3-6bf4-4fd7-b997-212d8a4a81de service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:55.096452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3bde3-6bf4-4fd7-b997-212d8a4a81de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:55.098033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6ce3bde3-6bf4-4fd7-b997-212d8a4a81de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:55.217321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3bde3-6bf4-4fd7-b997-212d8a4a81de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:55.218978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3bde3-6bf4-4fd7-b997-212d8a4a81de service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:55.238302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 729/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:48:57.494621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943f7f5-2ee7-4766-9a14-517aac18238d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:57.495400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943f7f5-2ee7-4766-9a14-517aac18238d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:57.495400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943f7f5-2ee7-4766-9a14-517aac18238d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:57.496708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:48:57.503038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792c1e-4f7d-4c57-9163-9045eb9e8ad1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:57.503551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792c1e-4f7d-4c57-9163-9045eb9e8ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:57.503551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792c1e-4f7d-4c57-9163-9045eb9e8ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:57.576173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8e792c1e-4f7d-4c57-9163-9045eb9e8ad1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:48:57.577385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8e792c1e-4f7d-4c57-9163-9045eb9e8ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:57.606926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:57.678936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:48:57.963026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943f7f5-2ee7-4766-9a14-517aac18238d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:48:57.964564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3943f7f5-2ee7-4766-9a14-517aac18238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:58.073983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943f7f5-2ee7-4766-9a14-517aac18238d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:48:58.107241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:58.152386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b03587-afbf-485d-9260-b5c874f901f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:48:58.152993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03587-afbf-485d-9260-b5c874f901f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:48:58.153269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03587-afbf-485d-9260-b5c874f901f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:48:58.153540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03587-afbf-485d-9260-b5c874f901f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:48:58.155730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f8b03587-afbf-485d-9260-b5c874f901f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:48:58.283570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b03587-afbf-485d-9260-b5c874f901f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:48:58.283570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b03587-afbf-485d-9260-b5c874f901f0 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:48:58.300907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 728/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:00.551260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1dc5-6564-4a8e-9af4-ab57f35f3a3c None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:00.551840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1dc5-6564-4a8e-9af4-ab57f35f3a3c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:00.551840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1dc5-6564-4a8e-9af4-ab57f35f3a3c None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:00.553172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:00.559015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aade2-e69b-4968-b8c2-9506d9da5e36 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:00.559506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aade2-e69b-4968-b8c2-9506d9da5e36 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:00.559613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aade2-e69b-4968-b8c2-9506d9da5e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:00.637129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f22aade2-e69b-4968-b8c2-9506d9da5e36 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:00.638353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f22aade2-e69b-4968-b8c2-9506d9da5e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:00.647645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:00.743041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:01.028339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f1dc5-6564-4a8e-9af4-ab57f35f3a3c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:01.030357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-789f1dc5-6564-4a8e-9af4-ab57f35f3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:01.157129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f1dc5-6564-4a8e-9af4-ab57f35f3a3c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:01.214543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:01.232717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65708a04-f08a-49a7-9c86-39e441c128c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:01.233384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708a04-f08a-49a7-9c86-39e441c128c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:01.233661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708a04-f08a-49a7-9c86-39e441c128c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:01.233927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65708a04-f08a-49a7-9c86-39e441c128c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:01.235606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-65708a04-f08a-49a7-9c86-39e441c128c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:01.350768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65708a04-f08a-49a7-9c86-39e441c128c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:01.352218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65708a04-f08a-49a7-9c86-39e441c128c3 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:01.370597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 732/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:03.687248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1498b-fd0c-41ff-a253-5cc521b2510d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:03.687806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1498b-fd0c-41ff-a253-5cc521b2510d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:03.687806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1498b-fd0c-41ff-a253-5cc521b2510d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:03.689306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:49:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:03.694803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bfca-d7c4-4bc2-a84b-bc9f0f898abb None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:03.695219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bfca-d7c4-4bc2-a84b-bc9f0f898abb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:03.695431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551bfca-d7c4-4bc2-a84b-bc9f0f898abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:03.766102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6551bfca-d7c4-4bc2-a84b-bc9f0f898abb None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:03.767638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6551bfca-d7c4-4bc2-a84b-bc9f0f898abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:03.808041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:03.870884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:04.154841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1498b-fd0c-41ff-a253-5cc521b2510d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:04.157014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0ac1498b-fd0c-41ff-a253-5cc521b2510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:04.260862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1498b-fd0c-41ff-a253-5cc521b2510d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:04.300514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:04.337361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad8640-d061-49a1-8184-13cb3364e0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:04.337966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad8640-d061-49a1-8184-13cb3364e0bc service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:04.338324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad8640-d061-49a1-8184-13cb3364e0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:04.338597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad8640-d061-49a1-8184-13cb3364e0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:04.340228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-38ad8640-d061-49a1-8184-13cb3364e0bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:04.470707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad8640-d061-49a1-8184-13cb3364e0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:04.472296 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad8640-d061-49a1-8184-13cb3364e0bc service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:04.494189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 731/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:06.682167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7465e5-ac85-4979-9de7-c11ba8f06c9e None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:06.682734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7465e5-ac85-4979-9de7-c11ba8f06c9e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:06.682734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7465e5-ac85-4979-9de7-c11ba8f06c9e None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:06.684075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:06.690837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b689-b95f-4e88-a92c-08c661028b7a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:06.691234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b689-b95f-4e88-a92c-08c661028b7a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:06.691416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b689-b95f-4e88-a92c-08c661028b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:06.762015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c5f0b689-b95f-4e88-a92c-08c661028b7a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:06.763320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c5f0b689-b95f-4e88-a92c-08c661028b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:06.782074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:06.867008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:07.152374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7465e5-ac85-4979-9de7-c11ba8f06c9e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:07.153931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7a7465e5-ac85-4979-9de7-c11ba8f06c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:07.267822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7465e5-ac85-4979-9de7-c11ba8f06c9e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:07.345941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:07.351988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f58c1-c2bc-4330-a467-19ebad3dbe64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:07.352590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f58c1-c2bc-4330-a467-19ebad3dbe64 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:07.353155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f58c1-c2bc-4330-a467-19ebad3dbe64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:07.353474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f58c1-c2bc-4330-a467-19ebad3dbe64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:07.355238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f33f58c1-c2bc-4330-a467-19ebad3dbe64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:07.480388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f58c1-c2bc-4330-a467-19ebad3dbe64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:07.481746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f58c1-c2bc-4330-a467-19ebad3dbe64 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:07.503759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 735/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:09.687476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133a75-648e-4cf3-984e-1ecfbe4e9f3d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:09.687902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133a75-648e-4cf3-984e-1ecfbe4e9f3d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:09.687902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133a75-648e-4cf3-984e-1ecfbe4e9f3d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:09.689277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:09.695191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c6983-c596-4584-a2ad-70d6f1eec1d4 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:09.695722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c6983-c596-4584-a2ad-70d6f1eec1d4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:09.695722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c6983-c596-4584-a2ad-70d6f1eec1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:09.766263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-bd8c6983-c596-4584-a2ad-70d6f1eec1d4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:09.767524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bd8c6983-c596-4584-a2ad-70d6f1eec1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:09.815800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:09.865409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:49:10.148649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c133a75-648e-4cf3-984e-1ecfbe4e9f3d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:10.150320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6c133a75-648e-4cf3-984e-1ecfbe4e9f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:10.268447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c133a75-648e-4cf3-984e-1ecfbe4e9f3d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:10.316130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:10.341202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823b93f-187e-4a76-92f1-af198e7236d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:10.341802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b93f-187e-4a76-92f1-af198e7236d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:10.342094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b93f-187e-4a76-92f1-af198e7236d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:10.342361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b93f-187e-4a76-92f1-af198e7236d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:10.344648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3823b93f-187e-4a76-92f1-af198e7236d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:10.452100 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823b93f-187e-4a76-92f1-af198e7236d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:10.453931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823b93f-187e-4a76-92f1-af198e7236d4 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:10.472441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 734/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:19.863881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=22 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:20.470217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=66 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:24.262999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521e4be-e00f-4735-beb3-15545054efc1 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:24.263718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521e4be-e00f-4735-beb3-15545054efc1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:24.263718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521e4be-e00f-4735-beb3-15545054efc1 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:24.265445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 737/1471] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:24.271080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f216d7-9fce-46a1-8c26-3183b617c104 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:24.271600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f216d7-9fce-46a1-8c26-3183b617c104 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:24.271600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f216d7-9fce-46a1-8c26-3183b617c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:24.337216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-55f216d7-9fce-46a1-8c26-3183b617c104 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:24.338423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-55f216d7-9fce-46a1-8c26-3183b617c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:24.552186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 735/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:24.850906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d839e0-f547-4441-a860-913770de015b None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:24.851188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d839e0-f547-4441-a860-913770de015b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:24.851457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d839e0-f547-4441-a860-913770de015b None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:24.852993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 738/1473] 10.222.0.49 () {54 vars in 962 bytes} [Fri Oct 28 09:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:24.858894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88af7-86da-44ae-b953-56cabbe9d55f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:24.859183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88af7-86da-44ae-b953-56cabbe9d55f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:24.859455 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88af7-86da-44ae-b953-56cabbe9d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:24.934693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-18b88af7-86da-44ae-b953-56cabbe9d55f None None] MFA Rules not processed for user `ff6aed7405ec4740b3c5971d24850ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:24.936617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-18b88af7-86da-44ae-b953-56cabbe9d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:24.958956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:25.015187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 736/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Fri Oct 28 09:49:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:25.022965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d839e0-f547-4441-a860-913770de015b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:25.024491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b7d839e0-f547-4441-a860-913770de015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:25.130477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d839e0-f547-4441-a860-913770de015b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:25.203507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a721f7-05f4-49fa-9664-18fd039b957a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:25.204109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a721f7-05f4-49fa-9664-18fd039b957a service glance] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:25.204380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a721f7-05f4-49fa-9664-18fd039b957a service glance] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:25.204642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a721f7-05f4-49fa-9664-18fd039b957a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:25.206215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-81a721f7-05f4-49fa-9664-18fd039b957a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:25.262610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:25.318560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a721f7-05f4-49fa-9664-18fd039b957a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:25.320027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a721f7-05f4-49fa-9664-18fd039b957a service glance] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:25.339343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 739/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:49:27.603543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab9f5-91a9-4a2e-8854-1784c0762784 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:27.604093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab9f5-91a9-4a2e-8854-1784c0762784 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:27.604093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab9f5-91a9-4a2e-8854-1784c0762784 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:27.605437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 737/1476] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:27.611711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e759d-db17-40e5-ae86-0e3fc8eee891 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:27.612208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e759d-db17-40e5-ae86-0e3fc8eee891 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:27.612300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e759d-db17-40e5-ae86-0e3fc8eee891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:27.687153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0e8e759d-db17-40e5-ae86-0e3fc8eee891 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:27.688449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0e8e759d-db17-40e5-ae86-0e3fc8eee891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:27.792731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 740/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:28.063458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab9f5-91a9-4a2e-8854-1784c0762784 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:28.065013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-814ab9f5-91a9-4a2e-8854-1784c0762784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:28.203062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab9f5-91a9-4a2e-8854-1784c0762784 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:28.254175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:28.298274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b994d-731b-4e70-85e2-ed3c5ae28fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:28.298914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b994d-731b-4e70-85e2-ed3c5ae28fdc admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:28.299187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b994d-731b-4e70-85e2-ed3c5ae28fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:28.299456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b994d-731b-4e70-85e2-ed3c5ae28fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:28.300092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b994d-731b-4e70-85e2-ed3c5ae28fdc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:28.301911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-497b994d-731b-4e70-85e2-ed3c5ae28fdc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:28.301911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:49:28.301911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:49:28.303388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b994d-731b-4e70-85e2-ed3c5ae28fdc admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:28.323474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 738/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Fri Oct 28 09:49:28 2022] GET /identity/v3/projects => generated 2553 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:49:30.532186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3234cb-e47a-4c15-b9bf-d6998483ec25 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:30.532770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3234cb-e47a-4c15-b9bf-d6998483ec25 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:30.532770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3234cb-e47a-4c15-b9bf-d6998483ec25 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:30.534094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 741/1479] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:30.539450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702cc2-2cfd-4ee2-b6d5-5cabf89ac79e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:30.539873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702cc2-2cfd-4ee2-b6d5-5cabf89ac79e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:30.539980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b702cc2-2cfd-4ee2-b6d5-5cabf89ac79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:30.612243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0b702cc2-2cfd-4ee2-b6d5-5cabf89ac79e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:30.613453 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0b702cc2-2cfd-4ee2-b6d5-5cabf89ac79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:30.715005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 739/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:31.004792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3234cb-e47a-4c15-b9bf-d6998483ec25 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:31.006790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fd3234cb-e47a-4c15-b9bf-d6998483ec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:31.016789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:31.175318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3234cb-e47a-4c15-b9bf-d6998483ec25 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:31.267330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:31.302871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfe5b8-a3df-4f06-afb4-95bd068b2cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:31.303488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfe5b8-a3df-4f06-afb4-95bd068b2cd4 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:31.304073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfe5b8-a3df-4f06-afb4-95bd068b2cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:31.304338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfe5b8-a3df-4f06-afb4-95bd068b2cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:31.305916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-19dfe5b8-a3df-4f06-afb4-95bd068b2cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:31.415991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfe5b8-a3df-4f06-afb4-95bd068b2cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:31.417601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfe5b8-a3df-4f06-afb4-95bd068b2cd4 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:31.437349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 742/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:33.819457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672b91-c59d-4902-8798-ae8d57f4039a None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:33.820042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672b91-c59d-4902-8798-ae8d57f4039a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:33.820042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a672b91-c59d-4902-8798-ae8d57f4039a None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:33.821395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 740/1482] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:33.827862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c16e4-a895-4398-9d41-d0f3a6b67f27 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:33.828324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c16e4-a895-4398-9d41-d0f3a6b67f27 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:33.828429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c16e4-a895-4398-9d41-d0f3a6b67f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:33.898408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-890c16e4-a895-4398-9d41-d0f3a6b67f27 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:33.899646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-890c16e4-a895-4398-9d41-d0f3a6b67f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:33.953214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:34.006227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 743/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:34.290529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a672b91-c59d-4902-8798-ae8d57f4039a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:34.292155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7a672b91-c59d-4902-8798-ae8d57f4039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:34.315927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:34.401859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a672b91-c59d-4902-8798-ae8d57f4039a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:34.482829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7235d6-508f-4168-bd34-b9121a0c57a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:34.483439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7235d6-508f-4168-bd34-b9121a0c57a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:34.483713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7235d6-508f-4168-bd34-b9121a0c57a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:34.483982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7235d6-508f-4168-bd34-b9121a0c57a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:34.485634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1b7235d6-508f-4168-bd34-b9121a0c57a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:34.562661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:34.600914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7235d6-508f-4168-bd34-b9121a0c57a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:34.602525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7235d6-508f-4168-bd34-b9121a0c57a4 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:34.624367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 741/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:36.842112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d80a4-ce2e-4308-bc53-475899620c55 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:36.843028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d80a4-ce2e-4308-bc53-475899620c55 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:36.843028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d80a4-ce2e-4308-bc53-475899620c55 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:36.844043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 744/1485] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:36.850036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebec0d-ed2c-4731-b0a7-7541752febaf None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:36.850543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebec0d-ed2c-4731-b0a7-7541752febaf None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:36.851101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebec0d-ed2c-4731-b0a7-7541752febaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:36.927370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-59ebec0d-ed2c-4731-b0a7-7541752febaf None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:36.928585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-59ebec0d-ed2c-4731-b0a7-7541752febaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:37.026375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 742/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:37.318677 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d80a4-ce2e-4308-bc53-475899620c55 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:37.320267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-487d80a4-ce2e-4308-bc53-475899620c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:37.429132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d80a4-ce2e-4308-bc53-475899620c55 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:37.503885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:37.505377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2d9bf-badd-453a-9c96-0f87b06b4e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:37.506235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2d9bf-badd-453a-9c96-0f87b06b4e0b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:37.506507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2d9bf-badd-453a-9c96-0f87b06b4e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:37.506805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2d9bf-badd-453a-9c96-0f87b06b4e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:37.510490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-90c2d9bf-badd-453a-9c96-0f87b06b4e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:37.621681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2d9bf-badd-453a-9c96-0f87b06b4e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:37.623190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2d9bf-badd-453a-9c96-0f87b06b4e0b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:37.641792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 745/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:39.914314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71803a1-2f54-462d-a4ee-3badb5b5e42f None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:39.914314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71803a1-2f54-462d-a4ee-3badb5b5e42f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:39.914964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71803a1-2f54-462d-a4ee-3badb5b5e42f None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:39.915932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 743/1488] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:39.921570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2795d5-6f52-43d3-8c57-879ed79fed99 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:39.922051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2795d5-6f52-43d3-8c57-879ed79fed99 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:39.922146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2795d5-6f52-43d3-8c57-879ed79fed99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:39.990763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ee2795d5-6f52-43d3-8c57-879ed79fed99 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:39.991883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ee2795d5-6f52-43d3-8c57-879ed79fed99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:40.047002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:40.092515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 746/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:49:40.382462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71803a1-2f54-462d-a4ee-3badb5b5e42f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:40.384026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a71803a1-2f54-462d-a4ee-3badb5b5e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:40.420595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:40.492141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71803a1-2f54-462d-a4ee-3badb5b5e42f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:40.566143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55f9a8-4308-4102-8294-7a5980b0bc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:40.566774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f9a8-4308-4102-8294-7a5980b0bc7a service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:40.567053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f9a8-4308-4102-8294-7a5980b0bc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:40.567320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55f9a8-4308-4102-8294-7a5980b0bc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:40.568912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-da55f9a8-4308-4102-8294-7a5980b0bc7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:40.650342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:40.684346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55f9a8-4308-4102-8294-7a5980b0bc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:40.685793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55f9a8-4308-4102-8294-7a5980b0bc7a service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:40.704442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 744/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:43.436015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead234-52da-4fab-9307-f8e73cc1d3b1 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:43.436604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead234-52da-4fab-9307-f8e73cc1d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:43.436604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead234-52da-4fab-9307-f8e73cc1d3b1 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:43.437885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 747/1491] 10.222.0.49 () {54 vars in 927 bytes} [Fri Oct 28 09:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:49:43.444318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931fca-a5a7-4921-83f2-c295794ff7ca None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:43.444736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931fca-a5a7-4921-83f2-c295794ff7ca None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:43.444864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931fca-a5a7-4921-83f2-c295794ff7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:43.517556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a3931fca-a5a7-4921-83f2-c295794ff7ca None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:49:43.518814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a3931fca-a5a7-4921-83f2-c295794ff7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:43.619104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 745/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Fri Oct 28 09:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:49:43.911170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead234-52da-4fab-9307-f8e73cc1d3b1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:49:43.912692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5cead234-52da-4fab-9307-f8e73cc1d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:44.034299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead234-52da-4fab-9307-f8e73cc1d3b1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:49:44.114425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805a02e-3db0-4c1d-ba6d-475524f5e6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:49:44.115064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805a02e-3db0-4c1d-ba6d-475524f5e6da service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:49:44.115343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805a02e-3db0-4c1d-ba6d-475524f5e6da service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:49:44.115613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805a02e-3db0-4c1d-ba6d-475524f5e6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:49:44.117218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6805a02e-3db0-4c1d-ba6d-475524f5e6da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:49:44.128363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:44.235433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805a02e-3db0-4c1d-ba6d-475524f5e6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:49:44.236909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805a02e-3db0-4c1d-ba6d-475524f5e6da service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:49:44.255213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 748/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:49:53.616458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=82 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:54.252909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=50 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:29.288763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e12a82-3e20-4d08-941e-ea1d5f390fef None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.289370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e12a82-3e20-4d08-941e-ea1d5f390fef None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.289370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e12a82-3e20-4d08-941e-ea1d5f390fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.374084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-16e12a82-3e20-4d08-941e-ea1d5f390fef None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:29.375373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-16e12a82-3e20-4d08-941e-ea1d5f390fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.485299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 746/1494] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:29.493590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6046a78-b324-41ca-aa35-74138ac14a99 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.494115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6046a78-b324-41ca-aa35-74138ac14a99 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.494115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6046a78-b324-41ca-aa35-74138ac14a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.519855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a6046a78-b324-41ca-aa35-74138ac14a99 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:29.521157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a6046a78-b324-41ca-aa35-74138ac14a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:29.529941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 749/1495] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:29.534662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e12a82-3e20-4d08-941e-ea1d5f390fef None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.544695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e12a82-3e20-4d08-941e-ea1d5f390fef None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.549828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.550429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.550731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.551002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.551673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:51:29.551970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.552971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:29.552971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:51:29.552971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:51:29.553847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.566632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 747/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:51:29.576419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6046a78-b324-41ca-aa35-74138ac14a99 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.585906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6046a78-b324-41ca-aa35-74138ac14a99 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.590609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.591247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.591525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.591795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.592438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.594204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING py.warnings [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:29.594204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: warnings.warn(msg) Oct 28 09:51:29.594204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: Oct 28 09:51:29.596358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.705771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 750/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:29.710285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.720823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ff35f-fd3e-4d3a-9299-2dec289721bf admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.772104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:29.778855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.779460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.779734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.780001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.780623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.782170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:29.782170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:51:29.782170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:51:29.783501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.882191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 748/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:51:29 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:51:29.886489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.897470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46204c-5389-4120-8d07-d85eb6404ffb admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.902350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.902991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.903269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.903532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.904171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.905197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING py.warnings [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:29.905197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: warnings.warn(msg) Oct 28 09:51:29.905197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: Oct 28 09:51:29.912367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.919695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 751/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:51:29.924663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.934828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7d62-9cda-4983-a90e-2d01ee0c6ea6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.939712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25e1c9-c156-49cc-a88e-ef45c06cbd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.940341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25e1c9-c156-49cc-a88e-ef45c06cbd3a admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.940619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25e1c9-c156-49cc-a88e-ef45c06cbd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.940877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25e1c9-c156-49cc-a88e-ef45c06cbd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.941509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25e1c9-c156-49cc-a88e-ef45c06cbd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.942543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-7e25e1c9-c156-49cc-a88e-ef45c06cbd3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:29.942543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:51:29.942543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:51:29.943994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25e1c9-c156-49cc-a88e-ef45c06cbd3a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:29.958192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 749/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:51:29.963409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:29.976452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103db17-71d6-43d9-9aa5-ff4a0e1a277f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:29.981057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42100fd3-5e7c-455b-812d-e35f46c2af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:29.981717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100fd3-5e7c-455b-812d-e35f46c2af4a admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:29.981998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100fd3-5e7c-455b-812d-e35f46c2af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:29.982273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42100fd3-5e7c-455b-812d-e35f46c2af4a admin admin] PATH_INFO: `/v3/projects/1e338a4e78c4441b86e091f4fd4aa1a2/users/a3fa9b451f09465ba767bbacb40fef27/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:29.998152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42100fd3-5e7c-455b-812d-e35f46c2af4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e338a4e78c4441b86e091f4fd4aa1a2, user_id=a3fa9b451f09465ba767bbacb40fef27, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:29.999223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING py.warnings [None req-42100fd3-5e7c-455b-812d-e35f46c2af4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:29.999223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: warnings.warn(msg) Oct 28 09:51:29.999223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: Oct 28 09:51:30.001497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42100fd3-5e7c-455b-812d-e35f46c2af4a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.077854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 752/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:51:29 2022] PUT /identity/v3/projects/1e338a4e78c4441b86e091f4fd4aa1a2/users/a3fa9b451f09465ba767bbacb40fef27/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:30.095632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0283f-51cc-4666-b7cb-5e0ee191f351 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.095917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0283f-51cc-4666-b7cb-5e0ee191f351 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.096191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0283f-51cc-4666-b7cb-5e0ee191f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.126339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6af0283f-51cc-4666-b7cb-5e0ee191f351 None None] MFA Rules not processed for user `a3fa9b451f09465ba767bbacb40fef27`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:30.127650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6af0283f-51cc-4666-b7cb-5e0ee191f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:30.196977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 750/1502] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:30.210601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b110-61aa-4ee6-8efd-d2b25dcaa570 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.210925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b110-61aa-4ee6-8efd-d2b25dcaa570 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.211349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b110-61aa-4ee6-8efd-d2b25dcaa570 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.212511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 753/1503] 10.222.0.49 () {54 vars in 957 bytes} [Fri Oct 28 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:51:30.217531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def50a5-d213-43d7-a65d-19e367aa0957 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.217808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def50a5-d213-43d7-a65d-19e367aa0957 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.218073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def50a5-d213-43d7-a65d-19e367aa0957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.280005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2def50a5-d213-43d7-a65d-19e367aa0957 None None] MFA Rules not processed for user `6b18f309b5cb4641997b637f8f17ac87`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:30.281346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2def50a5-d213-43d7-a65d-19e367aa0957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:30.358764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 751/1504] 10.222.0.49 () {58 vars in 1054 bytes} [Fri Oct 28 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:30.366475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b110-61aa-4ee6-8efd-d2b25dcaa570 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.377349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b110-61aa-4ee6-8efd-d2b25dcaa570 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.380854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b18f309b5cb4641997b637f8f17ac87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.381437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.381709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.381969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.390755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.396830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.402135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 754/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:30.448906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02546c-46a0-4b16-a2df-71929d77431a None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.449138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02546c-46a0-4b16-a2df-71929d77431a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.449406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02546c-46a0-4b16-a2df-71929d77431a None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.450718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 752/1506] 10.222.0.49 () {52 vars in 830 bytes} [Fri Oct 28 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:51:30.455198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.519142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e33c4-149c-4c97-ba87-6891c3df67c3 service cinder] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:30.523861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:30.524494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.524771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.525039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] PATH_INFO: `/v3/users/a3fa9b451f09465ba767bbacb40fef27` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.526179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fa9b451f09465ba767bbacb40fef27)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:30.527232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING py.warnings [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:30.527232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: warnings.warn(msg) Oct 28 09:51:30.527232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: Oct 28 09:51:30.528566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:30.739815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fa9b451f09465ba767bbacb40fef27'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:30.841639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fa9b451f09465ba767bbacb40fef27'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:30.867789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fa9b451f09465ba767bbacb40fef27'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:30.868550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fa9b451f09465ba767bbacb40fef27'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:30.881627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:30.886942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fa9b451f09465ba767bbacb40fef27'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:30.893416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 755/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:30 2022] DELETE /identity/v3/users/a3fa9b451f09465ba767bbacb40fef27 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:30.898064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:30.898349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:30.898629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:30.918873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:51:30.920077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:30.930153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:30.980521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 753/1508] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:51:30.998346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:30.998346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:31.080402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38a039-62b0-4c4d-a9f9-e6e26304c8e0 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:31.084043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7962e7d-31ec-4507-b5c4-725301d41a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:31.084674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7962e7d-31ec-4507-b5c4-725301d41a9c service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:31.084950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7962e7d-31ec-4507-b5c4-725301d41a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:31.085215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7962e7d-31ec-4507-b5c4-725301d41a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:31.094552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7962e7d-31ec-4507-b5c4-725301d41a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:31.096071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7962e7d-31ec-4507-b5c4-725301d41a9c service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:31.132089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 756/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:31.637664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:51:31.639222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:51:31.651695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4792cb6-f1d3-4160-857a-784d076e41b0 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:51:31.658651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:51:31.659442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:51:31.659779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:51:31.660119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] PATH_INFO: `/v3/projects/1e338a4e78c4441b86e091f4fd4aa1a2` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:51:31.661402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e338a4e78c4441b86e091f4fd4aa1a2)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:51:31.662585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:31.662585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:51:31.662585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:51:31.664166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:51:31.829987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e338a4e78c4441b86e091f4fd4aa1a2', 'request_id': 'req-d0b766ce-2221-4ca7-9982-5306c11ef4e8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:31.927579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e338a4e78c4441b86e091f4fd4aa1a2', 'request_id': 'req-d0b766ce-2221-4ca7-9982-5306c11ef4e8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:31.936126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e338a4e78c4441b86e091f4fd4aa1a2', 'request_id': 'req-d0b766ce-2221-4ca7-9982-5306c11ef4e8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:31.956982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] The token cache is being invalidate because project 1e338a4e78c4441b86e091f4fd4aa1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:51:31.958014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:31.959031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d0b766ce-2221-4ca7-9982-5306c11ef4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:51:31.961098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 754/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:31 2022] DELETE /identity/v3/projects/1e338a4e78c4441b86e091f4fd4aa1a2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:51:41.102500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=38 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:41.952750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:47.146440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427eddd-5747-4bb1-b7d8-ece327af8c58 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:47.147073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427eddd-5747-4bb1-b7d8-ece327af8c58 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:47.147073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427eddd-5747-4bb1-b7d8-ece327af8c58 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:47.148358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:47.153418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c17f8-6adf-443d-8c01-5f1c8f02d539 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:47.153828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c17f8-6adf-443d-8c01-5f1c8f02d539 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:47.153973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c17f8-6adf-443d-8c01-5f1c8f02d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:47.174289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-838c17f8-6adf-443d-8c01-5f1c8f02d539 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:47.175518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-838c17f8-6adf-443d-8c01-5f1c8f02d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:47.232740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:47.383964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427eddd-5747-4bb1-b7d8-ece327af8c58 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:47.385631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7427eddd-5747-4bb1-b7d8-ece327af8c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:47.486267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427eddd-5747-4bb1-b7d8-ece327af8c58 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:47.491559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172dbe8-2ff6-4345-887e-0cd834167fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:47.492151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172dbe8-2ff6-4345-887e-0cd834167fbd service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:47.492426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172dbe8-2ff6-4345-887e-0cd834167fbd service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:47.492698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172dbe8-2ff6-4345-887e-0cd834167fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:47.500858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172dbe8-2ff6-4345-887e-0cd834167fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:47.502436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172dbe8-2ff6-4345-887e-0cd834167fbd service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:47.511672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 758/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:48.594441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45b99-cf27-4329-a048-2097f27a14f3 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:48.594996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45b99-cf27-4329-a048-2097f27a14f3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:48.594996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a45b99-cf27-4329-a048-2097f27a14f3 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:48.596827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:52:48.602986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126e3e-f52b-4237-8847-c4c650986c3f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:48.603436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126e3e-f52b-4237-8847-c4c650986c3f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:48.603539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126e3e-f52b-4237-8847-c4c650986c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:48.623788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-5a126e3e-f52b-4237-8847-c4c650986c3f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:48.624972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5a126e3e-f52b-4237-8847-c4c650986c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:48.632676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:48.782697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45b99-cf27-4329-a048-2097f27a14f3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:52:48.798507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a45b99-cf27-4329-a048-2097f27a14f3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:52:48.804156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108ee84-6b67-4173-baff-9a851fe4d410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:52:48.804777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ee84-6b67-4173-baff-9a851fe4d410 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:48.805041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ee84-6b67-4173-baff-9a851fe4d410 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:48.805314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ee84-6b67-4173-baff-9a851fe4d410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:48.814277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108ee84-6b67-4173-baff-9a851fe4d410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:52:48.815892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108ee84-6b67-4173-baff-9a851fe4d410 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:52:48.829273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 757/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:52:53.582185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae591e-b6ff-4e3a-9400-c3925dc630be None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.582745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae591e-b6ff-4e3a-9400-c3925dc630be None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.582745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae591e-b6ff-4e3a-9400-c3925dc630be None None] PATH_INFO: `/v3` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.584033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 760/1517] 10.222.0.48 () {54 vars in 925 bytes} [Fri Oct 28 09:52:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:52:53.598567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718ab8-5123-48ef-8ff9-fb92ec2ffd9b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:52:53.599012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718ab8-5123-48ef-8ff9-fb92ec2ffd9b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:52:53.599151 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2718ab8-5123-48ef-8ff9-fb92ec2ffd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:52:53.650514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b2718ab8-5123-48ef-8ff9-fb92ec2ffd9b None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:52:53.651809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b2718ab8-5123-48ef-8ff9-fb92ec2ffd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:52:53.730311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 758/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Oct 28 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:52:58.618789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=49 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:00.320852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e837a-e178-4b47-8cf5-6370823a9aa8 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:00.321523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e837a-e178-4b47-8cf5-6370823a9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:00.321523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e837a-e178-4b47-8cf5-6370823a9aa8 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:00.322775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 761/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:00.329426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6239-982a-44a0-8e55-3364d9d6f25e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:00.329884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6239-982a-44a0-8e55-3364d9d6f25e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:00.330010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6239-982a-44a0-8e55-3364d9d6f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:00.349801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-525d6239-982a-44a0-8e55-3364d9d6f25e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:00.351010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-525d6239-982a-44a0-8e55-3364d9d6f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:00.359127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 759/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:00.511345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e837a-e178-4b47-8cf5-6370823a9aa8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:00.527792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e837a-e178-4b47-8cf5-6370823a9aa8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:00.533619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc830d36-85bf-4756-b73e-6cda432af10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:00.534232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830d36-85bf-4756-b73e-6cda432af10d service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:00.534512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830d36-85bf-4756-b73e-6cda432af10d service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:00.534808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc830d36-85bf-4756-b73e-6cda432af10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:00.544080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc830d36-85bf-4756-b73e-6cda432af10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:00.545700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc830d36-85bf-4756-b73e-6cda432af10d service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:00.556596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 762/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:01.629003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94523a-f009-44cd-85f9-8c3bd152280c None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:01.629592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94523a-f009-44cd-85f9-8c3bd152280c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:01.629592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94523a-f009-44cd-85f9-8c3bd152280c None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:01.630940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:01.637196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62b60b-443e-4132-a561-0927e4c62521 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:01.637677 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62b60b-443e-4132-a561-0927e4c62521 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:01.637791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62b60b-443e-4132-a561-0927e4c62521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:01.656766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4f62b60b-443e-4132-a561-0927e4c62521 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:01.657968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4f62b60b-443e-4132-a561-0927e4c62521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:01.665603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:01.818119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94523a-f009-44cd-85f9-8c3bd152280c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:01.831999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94523a-f009-44cd-85f9-8c3bd152280c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:01.837357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a9b8b-b6f4-4335-ad09-86d83100f347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:01.837934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9b8b-b6f4-4335-ad09-86d83100f347 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:01.838205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9b8b-b6f4-4335-ad09-86d83100f347 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:01.838618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a9b8b-b6f4-4335-ad09-86d83100f347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:01.846864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9b8b-b6f4-4335-ad09-86d83100f347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:01.848429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a9b8b-b6f4-4335-ad09-86d83100f347 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:01.857445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 761/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:02.562169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e661-8e93-4c29-9869-05c1f6e652e4 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:02.562450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e661-8e93-4c29-9869-05c1f6e652e4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:02.562741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073e661-8e93-4c29-9869-05c1f6e652e4 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:02.564128 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 764/1525] 10.222.0.49 () {54 vars in 961 bytes} [Fri Oct 28 09:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:02.569034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fc37-7e62-4d4f-9213-15acda1894b0 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:02.569314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fc37-7e62-4d4f-9213-15acda1894b0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:02.569606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fc37-7e62-4d4f-9213-15acda1894b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:02.593527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7ab2fc37-7e62-4d4f-9213-15acda1894b0 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:02.595402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7ab2fc37-7e62-4d4f-9213-15acda1894b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:02.603823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 762/1526] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Oct 28 09:53:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:02.611356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e661-8e93-4c29-9869-05c1f6e652e4 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:02.624892 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073e661-8e93-4c29-9869-05c1f6e652e4 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:02.630489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b564a8-2046-44ef-aa4a-cf1a9809692a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:02.631125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b564a8-2046-44ef-aa4a-cf1a9809692a service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:02.631432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b564a8-2046-44ef-aa4a-cf1a9809692a service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:02.631700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b564a8-2046-44ef-aa4a-cf1a9809692a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:02.640029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b564a8-2046-44ef-aa4a-cf1a9809692a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:02.642216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b564a8-2046-44ef-aa4a-cf1a9809692a service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:02.651839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 765/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:12.584712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:12.647890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=15 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:13.332310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8101-d857-43b8-ab6e-72ad8997dd1b None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:13.332591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8101-d857-43b8-ab6e-72ad8997dd1b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:13.332862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da8101-d857-43b8-ab6e-72ad8997dd1b None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:13.334244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:13.340496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6bf41-c5c7-4744-8a6a-e1d6a7ac04d7 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:13.340778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6bf41-c5c7-4744-8a6a-e1d6a7ac04d7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:13.341045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6bf41-c5c7-4744-8a6a-e1d6a7ac04d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:13.361504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-24d6bf41-c5c7-4744-8a6a-e1d6a7ac04d7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:13.362746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-24d6bf41-c5c7-4744-8a6a-e1d6a7ac04d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:13.370477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:13.523650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da8101-d857-43b8-ab6e-72ad8997dd1b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:13.538168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da8101-d857-43b8-ab6e-72ad8997dd1b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:13.543536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46487a51-f8b4-4750-b920-8b9423fe72a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:13.544123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487a51-f8b4-4750-b920-8b9423fe72a7 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:13.544401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487a51-f8b4-4750-b920-8b9423fe72a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:13.544668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487a51-f8b4-4750-b920-8b9423fe72a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:13.552699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46487a51-f8b4-4750-b920-8b9423fe72a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:13.554303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46487a51-f8b4-4750-b920-8b9423fe72a7 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:13.563960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 764/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:14.631715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c367-4155-4bb6-b714-c1526d71f7d4 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:14.632295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c367-4155-4bb6-b714-c1526d71f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:14.632295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10c367-4155-4bb6-b714-c1526d71f7d4 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:14.633609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 09:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:14.639659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5edb03-5492-49ed-bf6c-238016d47bc6 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:14.640081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5edb03-5492-49ed-bf6c-238016d47bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:14.640213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5edb03-5492-49ed-bf6c-238016d47bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:14.660893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fa5edb03-5492-49ed-bf6c-238016d47bc6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:14.662119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fa5edb03-5492-49ed-bf6c-238016d47bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:14.669905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 09:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:14.819993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c367-4155-4bb6-b714-c1526d71f7d4 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:14.833997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10c367-4155-4bb6-b714-c1526d71f7d4 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:14.839392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779c22d-573d-4360-b5e6-4bf5ead85bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:14.839970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c22d-573d-4360-b5e6-4bf5ead85bc1 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:14.840241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c22d-573d-4360-b5e6-4bf5ead85bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:14.840504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779c22d-573d-4360-b5e6-4bf5ead85bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:14.848866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779c22d-573d-4360-b5e6-4bf5ead85bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:14.850428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779c22d-573d-4360-b5e6-4bf5ead85bc1 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:14.859725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 768/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:19.314756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760b8e4-1157-40a6-9c7f-6413866647b9 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:19.315399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760b8e4-1157-40a6-9c7f-6413866647b9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:19.315399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760b8e4-1157-40a6-9c7f-6413866647b9 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:19.316699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:19.322107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459a3b-31ae-4247-8dec-a5bac1385fb2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:19.322524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459a3b-31ae-4247-8dec-a5bac1385fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:19.322633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11459a3b-31ae-4247-8dec-a5bac1385fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:19.348181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-11459a3b-31ae-4247-8dec-a5bac1385fb2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:19.350193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-11459a3b-31ae-4247-8dec-a5bac1385fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:19.357949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:19.643868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760b8e4-1157-40a6-9c7f-6413866647b9 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:19.646106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d760b8e4-1157-40a6-9c7f-6413866647b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:19.706104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760b8e4-1157-40a6-9c7f-6413866647b9 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:19.709759 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ec9a9-9234-4758-bf32-e62527fc4581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:19.710393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec9a9-9234-4758-bf32-e62527fc4581 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:19.710688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec9a9-9234-4758-bf32-e62527fc4581 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:19.710952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec9a9-9234-4758-bf32-e62527fc4581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:19.720098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ec9a9-9234-4758-bf32-e62527fc4581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:19.721514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ec9a9-9234-4758-bf32-e62527fc4581 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:19.730895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 767/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:21.931028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b70810-6df1-4c99-8f1e-d7c8705ab5dc None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:21.931599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b70810-6df1-4c99-8f1e-d7c8705ab5dc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:21.931599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b70810-6df1-4c99-8f1e-d7c8705ab5dc None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:21.932926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 09:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:53:21.938117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df585414-b955-4247-bfdd-a005597b1077 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:21.938538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df585414-b955-4247-bfdd-a005597b1077 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:21.938641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df585414-b955-4247-bfdd-a005597b1077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:21.958331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-df585414-b955-4247-bfdd-a005597b1077 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:53:21.959532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-df585414-b955-4247-bfdd-a005597b1077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:53:21.967117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:53:22.246714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b70810-6df1-4c99-8f1e-d7c8705ab5dc None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:53:22.257805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b70810-6df1-4c99-8f1e-d7c8705ab5dc None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:53:22.261466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b91ff6-0097-41d3-affb-c4c245bc4747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:53:22.262052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b91ff6-0097-41d3-affb-c4c245bc4747 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:53:22.262323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b91ff6-0097-41d3-affb-c4c245bc4747 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:53:22.262584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b91ff6-0097-41d3-affb-c4c245bc4747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:53:22.271548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b91ff6-0097-41d3-affb-c4c245bc4747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:53:22.278746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b91ff6-0097-41d3-affb-c4c245bc4747 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:53:22.283161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 771/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:53:31.953111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=38 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:32.278288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=18 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:39.551221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487c89-2792-4c2e-8fdc-557f1e0f6bab None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.552198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487c89-2792-4c2e-8fdc-557f1e0f6bab None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.552615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487c89-2792-4c2e-8fdc-557f1e0f6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.579081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cb487c89-2792-4c2e-8fdc-557f1e0f6bab None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:39.580582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cb487c89-2792-4c2e-8fdc-557f1e0f6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:39.595423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 769/1540] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:39.600199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74999d-e5c2-45ff-91f7-54792fd5727b None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.600701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74999d-e5c2-45ff-91f7-54792fd5727b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.600776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74999d-e5c2-45ff-91f7-54792fd5727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.623269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bb4b-0eae-4a78-b720-648ff7e8aba7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.623793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bb4b-0eae-4a78-b720-648ff7e8aba7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.624213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8bb4b-0eae-4a78-b720-648ff7e8aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.628201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ed74999d-e5c2-45ff-91f7-54792fd5727b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:39.629635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ed74999d-e5c2-45ff-91f7-54792fd5727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:39.643123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 772/1541] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:39.655948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c6b8bb4b-0eae-4a78-b720-648ff7e8aba7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:39.657174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c6b8bb4b-0eae-4a78-b720-648ff7e8aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:39.665104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36799-9568-4ae5-bcb9-abea6cda8b5b None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.665644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36799-9568-4ae5-bcb9-abea6cda8b5b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.666070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca36799-9568-4ae5-bcb9-abea6cda8b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.672511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 770/1542] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:54:39.677389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bb4b-0eae-4a78-b720-648ff7e8aba7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:39.698097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8bb4b-0eae-4a78-b720-648ff7e8aba7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:39.708110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:39.709027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.709468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.709922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.710756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:39.711276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:39.713059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-3ca36799-9568-4ae5-bcb9-abea6cda8b5b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:39.713249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:39.714538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3ca36799-9568-4ae5-bcb9-abea6cda8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:39.740952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 773/1543] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:39.754863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 771/1544] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:54:39.756239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36799-9568-4ae5-bcb9-abea6cda8b5b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:39.759848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:39.766368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca36799-9568-4ae5-bcb9-abea6cda8b5b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:39.779099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71fc79-cca6-4f60-9932-0b95ce08f670 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:39.785272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:39.785930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.786208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.786480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.787168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:39.787472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:39.788603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING py.warnings [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:39.788603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: warnings.warn(msg) Oct 28 09:54:39.788603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: Oct 28 09:54:39.789505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:39.789892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30cd75-a912-4305-aaad-d3b4e6737bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:39.790755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cd75-a912-4305-aaad-d3b4e6737bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.791232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cd75-a912-4305-aaad-d3b4e6737bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.791696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30cd75-a912-4305-aaad-d3b4e6737bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.792553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30cd75-a912-4305-aaad-d3b4e6737bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:39.793756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-bb30cd75-a912-4305-aaad-d3b4e6737bc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:39.793756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:54:39.793756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:54:39.800356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30cd75-a912-4305-aaad-d3b4e6737bc4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:39.813409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 774/1545] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:39.840256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:39.861773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff06e12-7ede-4d68-bffc-697971200e94 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:39.879443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b97e-4746-4033-a50e-2652c1a0a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:39.880135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b97e-4746-4033-a50e-2652c1a0a13d admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.880386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b97e-4746-4033-a50e-2652c1a0a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.880651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b97e-4746-4033-a50e-2652c1a0a13d admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.881309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0b97e-4746-4033-a50e-2652c1a0a13d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:39.883368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0b97e-4746-4033-a50e-2652c1a0a13d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:39.916747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 772/1546] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/projects => generated 411 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:39.917996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659553-bf3c-4f4d-ad40-4f097f833801 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.918297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659553-bf3c-4f4d-ad40-4f097f833801 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.918572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659553-bf3c-4f4d-ad40-4f097f833801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:39.949117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-00659553-bf3c-4f4d-ad40-4f097f833801 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:39.953149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-00659553-bf3c-4f4d-ad40-4f097f833801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:39.979099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 775/1547] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/projects => generated 355 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:54:39.982108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdb7b5-2d34-4db7-9f8d-1daf15031388 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:39.982108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdb7b5-2d34-4db7-9f8d-1daf15031388 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:39.982108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdb7b5-2d34-4db7-9f8d-1daf15031388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.023708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-42cdb7b5-2d34-4db7-9f8d-1daf15031388 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.025217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-42cdb7b5-2d34-4db7-9f8d-1daf15031388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.047365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 773/1548] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.048007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659553-bf3c-4f4d-ad40-4f097f833801 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.069010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659553-bf3c-4f4d-ad40-4f097f833801 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.134536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 776/1549] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.136490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15f15-2366-47b7-85f1-c839879ad0f2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.136981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15f15-2366-47b7-85f1-c839879ad0f2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.137453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da15f15-2366-47b7-85f1-c839879ad0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.143416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da5b52-ab42-4f05-be6a-d5306c948fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.144067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da5b52-ab42-4f05-be6a-d5306c948fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.144439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da5b52-ab42-4f05-be6a-d5306c948fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.144733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da5b52-ab42-4f05-be6a-d5306c948fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.145455 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da5b52-ab42-4f05-be6a-d5306c948fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.148614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da5b52-ab42-4f05-be6a-d5306c948fc2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.159413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8da15f15-2366-47b7-85f1-c839879ad0f2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.160519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8da15f15-2366-47b7-85f1-c839879ad0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.169882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 777/1550] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.175319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da15f15-2366-47b7-85f1-c839879ad0f2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.180560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da15f15-2366-47b7-85f1-c839879ad0f2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.185437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf729f5-f9d5-4c16-8b3d-2e01d4e07744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.186036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf729f5-f9d5-4c16-8b3d-2e01d4e07744 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.186314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf729f5-f9d5-4c16-8b3d-2e01d4e07744 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.186578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf729f5-f9d5-4c16-8b3d-2e01d4e07744 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.187267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf729f5-f9d5-4c16-8b3d-2e01d4e07744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.188293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING py.warnings [None req-ccf729f5-f9d5-4c16-8b3d-2e01d4e07744 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:40.188293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: warnings.warn(msg) Oct 28 09:54:40.188293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: Oct 28 09:54:40.189497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf729f5-f9d5-4c16-8b3d-2e01d4e07744 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.228664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 774/1551] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/users => generated 306 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:40.230007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741361-966a-4813-9328-b397c857d2fe None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.230331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741361-966a-4813-9328-b397c857d2fe None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.230577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741361-966a-4813-9328-b397c857d2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.250935 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-34741361-966a-4813-9328-b397c857d2fe None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.252120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-34741361-966a-4813-9328-b397c857d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.260051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 775/1552] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.261229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb018-d132-446a-9ca6-23e2149bc6e7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.261514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb018-d132-446a-9ca6-23e2149bc6e7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.261766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb018-d132-446a-9ca6-23e2149bc6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.280669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-825eb018-d132-446a-9ca6-23e2149bc6e7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.281801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-825eb018-d132-446a-9ca6-23e2149bc6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.289644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 776/1553] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.290811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999166a-d934-40d1-8d51-6c79ad546af2 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.291089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999166a-d934-40d1-8d51-6c79ad546af2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.291354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999166a-d934-40d1-8d51-6c79ad546af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.311231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2999166a-d934-40d1-8d51-6c79ad546af2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.312393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2999166a-d934-40d1-8d51-6c79ad546af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.320578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 777/1554] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.321677 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0cd3-aaca-40f5-a37b-8484579637f4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.321952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0cd3-aaca-40f5-a37b-8484579637f4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.322217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0cd3-aaca-40f5-a37b-8484579637f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.342155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 778/1555] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/users => generated 278 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:40.342155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6693-2965-43bb-9a40-52595939a687 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.342155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6693-2965-43bb-9a40-52595939a687 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.342155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6693-2965-43bb-9a40-52595939a687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.344907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b3cd0cd3-aaca-40f5-a37b-8484579637f4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.346063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b3cd0cd3-aaca-40f5-a37b-8484579637f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.354051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 778/1556] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.360328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c21b88-1dd4-4f8b-9cc0-2666439eaa21 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.360328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c21b88-1dd4-4f8b-9cc0-2666439eaa21 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.360328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c21b88-1dd4-4f8b-9cc0-2666439eaa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.367886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-799e6693-2965-43bb-9a40-52595939a687 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.369110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-799e6693-2965-43bb-9a40-52595939a687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.377322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-36c21b88-1dd4-4f8b-9cc0-2666439eaa21 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.378279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-36c21b88-1dd4-4f8b-9cc0-2666439eaa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.381145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 779/1557] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.381145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6693-2965-43bb-9a40-52595939a687 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.391161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6693-2965-43bb-9a40-52595939a687 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.395703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 779/1558] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.396599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c21b88-1dd4-4f8b-9cc0-2666439eaa21 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.399465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1f15b-de79-482a-97d0-c92f8253c418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.400151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1f15b-de79-482a-97d0-c92f8253c418 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.400431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1f15b-de79-482a-97d0-c92f8253c418 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.400700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1f15b-de79-482a-97d0-c92f8253c418 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.401349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1f15b-de79-482a-97d0-c92f8253c418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.403095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1f15b-de79-482a-97d0-c92f8253c418 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.407776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c21b88-1dd4-4f8b-9cc0-2666439eaa21 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.412514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99ed12-fabf-4f64-81d8-2ee69b935cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.413084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99ed12-fabf-4f64-81d8-2ee69b935cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.413355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99ed12-fabf-4f64-81d8-2ee69b935cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.413621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99ed12-fabf-4f64-81d8-2ee69b935cf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.414417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99ed12-fabf-4f64-81d8-2ee69b935cf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:40.414524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 780/1559] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:40.414749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99ed12-fabf-4f64-81d8-2ee69b935cf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.415796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461435-ea62-46c4-8c04-66041cf3bba8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.416081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461435-ea62-46c4-8c04-66041cf3bba8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.416344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99ed12-fabf-4f64-81d8-2ee69b935cf8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.416436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461435-ea62-46c4-8c04-66041cf3bba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.418972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:40.429855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 780/1560] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:40.432998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d062bc2-9c30-40f3-a5c3-0ab62f71e9e0 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.432998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d062bc2-9c30-40f3-a5c3-0ab62f71e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.432998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d062bc2-9c30-40f3-a5c3-0ab62f71e9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.437968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-21461435-ea62-46c4-8c04-66041cf3bba8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.439478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-21461435-ea62-46c4-8c04-66041cf3bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.447821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 781/1561] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.448492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461435-ea62-46c4-8c04-66041cf3bba8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.453466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2d062bc2-9c30-40f3-a5c3-0ab62f71e9e0 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.454655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2d062bc2-9c30-40f3-a5c3-0ab62f71e9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.459246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461435-ea62-46c4-8c04-66041cf3bba8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.467852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 781/1562] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.467852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d062bc2-9c30-40f3-a5c3-0ab62f71e9e0 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.468047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121aff5-4b16-45a5-a98a-f4b09d12992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.468047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121aff5-4b16-45a5-a98a-f4b09d12992e admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.468047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121aff5-4b16-45a5-a98a-f4b09d12992e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.468047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121aff5-4b16-45a5-a98a-f4b09d12992e admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.468350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121aff5-4b16-45a5-a98a-f4b09d12992e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.468350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121aff5-4b16-45a5-a98a-f4b09d12992e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.473715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d062bc2-9c30-40f3-a5c3-0ab62f71e9e0 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.478552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 782/1563] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:40.479120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.479866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb948838-6b71-4693-9685-cfdb2c9a130c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.479979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.480108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb948838-6b71-4693-9685-cfdb2c9a130c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.480381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb948838-6b71-4693-9685-cfdb2c9a130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.480488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.480843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.481626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:40.482420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.484173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.497448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 782/1564] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:40.501031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-fb948838-6b71-4693-9685-cfdb2c9a130c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:40.501347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fb948838-6b71-4693-9685-cfdb2c9a130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:40.503615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.510730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 783/1565] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:40.511685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb948838-6b71-4693-9685-cfdb2c9a130c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.514418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f030e-9a69-4677-a26c-147c49267052 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.519251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.520246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.520522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.520791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.521429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:40.521722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.523345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.524480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb948838-6b71-4693-9685-cfdb2c9a130c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.530628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.531743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.532035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.532304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.532981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.535067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.536481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 783/1566] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:40.537278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.547163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61d764-085b-4dd4-b681-9313aa9d753f admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.554180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 784/1567] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:40.554328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.555043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.555150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.555150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.555150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.555150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.555887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.562125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bcfa6-88b9-4863-ac09-2523101d6925 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.566755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.567245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.567521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.567791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.568423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:40.568723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.570350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.583356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 785/1568] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:40.584100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.594909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a283232-c77c-45bb-ad53-5f858ee1bfb4 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.599575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.600156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.600431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.600984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.601317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:40.601615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.603282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.615226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 786/1569] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:40.616038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.626154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d63c2-a367-432a-b4bd-2588ae49769f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.630753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.631329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.631600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.631885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.632642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.634213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.636377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:40.643063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 784/1570] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:40.646507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 787/1571] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:40.647050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.651543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.658752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db620c60-c436-4e96-8aa8-4cdc2b8bd7aa admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.716938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3417a6-4e80-46c2-9fd7-1f59fe7f6ddb admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.721747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.722350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.722626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.723007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.723636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.725229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.725629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.725829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.726102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.726392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.727053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:40.727349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.728917 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.742853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 788/1572] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:40.743776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.754136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a46f9-7c79-4f58-be4b-bc3cde37f115 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.758832 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.759436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.759714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.759984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.760615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.762537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.835922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 785/1573] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:40.836803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.870215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 789/1574] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:40.879903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:40.912543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9137bb-2553-490c-8b02-449b76334e11 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.940279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7534-7456-4135-88ce-9ecee722601a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:40.943809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:40.945579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.946176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.946449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.946749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.947373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.949290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:40.971346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:40.972005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:40.972277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:40.972543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] PATH_INFO: `/v3/projects/722b078fbcd543f8803c68728149244d/users/c406b078597340fd9424f246834eef69/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:40.988107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] RBAC: Authorizing `identity:create_grant(project_id=722b078fbcd543f8803c68728149244d, user_id=c406b078597340fd9424f246834eef69, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:40.989140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:40.989140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:54:40.989140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:54:40.991209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.023606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 790/1575] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:40 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.024582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.075005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 786/1576] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:40 2022] PUT /identity/v3/projects/722b078fbcd543f8803c68728149244d/users/c406b078597340fd9424f246834eef69/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:41.076462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.088456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f83cf-6f32-428f-9733-6964d02570d5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.089319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:41.143446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa384dd-99c7-4d0c-a21e-1bc7b013079d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.148238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.148849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.149066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.149191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.149376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.149673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.149950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.150059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.150218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.150875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.151934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.152765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.240171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 787/1577] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.241214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.252121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9941f-2b82-453d-949a-e5e02559593d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.256808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.257449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.257833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.257976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] PATH_INFO: `/v3/projects/09bc2a00a0b243cdae9197b85a8b18d2/users/d68034a487c9438cbee62386724db1e1/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.265416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 791/1578] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.268584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.273847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bc2a00a0b243cdae9197b85a8b18d2, user_id=d68034a487c9438cbee62386724db1e1, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.276770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.333760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cab02c-5f65-4893-bb86-87b34834e592 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.343249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.343249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.343249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.343249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.343598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.343598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.365997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 788/1579] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:41 2022] PUT /identity/v3/projects/09bc2a00a0b243cdae9197b85a8b18d2/users/d68034a487c9438cbee62386724db1e1/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:41.370526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.430296 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d045e-87f0-41e1-bbb5-4d5abcab1e1c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.435706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.436311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.436586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.436855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.437477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.439442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.442596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 792/1580] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.443887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.506901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58dde-aabf-425b-b574-aec1bb67467a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.511623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98ca04-048c-48ca-a023-b010a3f0efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.512227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98ca04-048c-48ca-a023-b010a3f0efaa admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.512533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98ca04-048c-48ca-a023-b010a3f0efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.512785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98ca04-048c-48ca-a023-b010a3f0efaa admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.513423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98ca04-048c-48ca-a023-b010a3f0efaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.515433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98ca04-048c-48ca-a023-b010a3f0efaa admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.554186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 789/1581] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.555389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.565185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d29ea-2889-471c-8c3c-626bce1bfd36 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.569816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.570407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.570721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.570993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.571612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.573524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.583594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:41.617699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 793/1582] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.618928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060181f1-9018-4272-bd3e-b40c7339d7ff None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.619213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060181f1-9018-4272-bd3e-b40c7339d7ff None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.619485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060181f1-9018-4272-bd3e-b40c7339d7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.626408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:41.647341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-060181f1-9018-4272-bd3e-b40c7339d7ff None None] MFA Rules not processed for user `c406b078597340fd9424f246834eef69`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:41.648551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-060181f1-9018-4272-bd3e-b40c7339d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:41.708236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 790/1583] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.709162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.717063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 794/1584] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:41.717063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060181f1-9018-4272-bd3e-b40c7339d7ff None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.725221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7186-1952-4149-9912-e0dbddb67eda admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.730482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3bc88-c264-4531-a289-03b3ca923025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.731216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060181f1-9018-4272-bd3e-b40c7339d7ff None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.732100 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bc88-c264-4531-a289-03b3ca923025 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.732100 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bc88-c264-4531-a289-03b3ca923025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.732386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3bc88-c264-4531-a289-03b3ca923025 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.732960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3bc88-c264-4531-a289-03b3ca923025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.734548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3bc88-c264-4531-a289-03b3ca923025 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.737060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.737662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.737935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.738222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.738883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.740783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.746460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 791/1585] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:41.747963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593893-355d-4755-88b8-e4adc4ef45d7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.748306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593893-355d-4755-88b8-e4adc4ef45d7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.748631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca593893-355d-4755-88b8-e4adc4ef45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.779858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ca593893-355d-4755-88b8-e4adc4ef45d7 None None] MFA Rules not processed for user `d68034a487c9438cbee62386724db1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:41.781093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ca593893-355d-4755-88b8-e4adc4ef45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:41.838130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 795/1586] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:41.839261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.850276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 792/1587] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:41.851140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca593893-355d-4755-88b8-e4adc4ef45d7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.851369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed664a-1a8f-429b-9f63-807844ab9d17 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.858099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.858741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.859014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.859286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.859911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.861841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.864655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca593893-355d-4755-88b8-e4adc4ef45d7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.872788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.872788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.872788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.872788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.873324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.874559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.885215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 793/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:41.886032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.896001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68012-081d-40b9-adf8-9e4076230c9a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.900649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.901242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.906616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.906616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.906616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.906616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.914754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 794/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:41.915572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.928743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5a33-2267-4b32-be66-c36ed0912434 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.933602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.935370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.935370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.935370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.935370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.936969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:41.947659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 795/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:41.948425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:41.958921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720c5d4-4de5-42e0-a6f4-6340178b578b admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:41.963683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:41.964252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:41.964529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:41.964794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:41.965417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:41.967891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.011610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 796/1591] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:42.012456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.023072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04db95-267e-44e0-b6aa-c4586932d6ac admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.027949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.029208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.029487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.029761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.030421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.032141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.043465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 797/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.061497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.061497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c57fe-2327-46f7-a9b9-6d2b7b25841a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.061497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.061497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.062018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.062018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.062018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.062539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.073407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 798/1593] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.082559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.085879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6f784-91f4-4aed-a782-c7f5c01cfd49 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.087743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 796/1594] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:41 2022] POST /identity/v3/projects => generated 411 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:42.088584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.152657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.153209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.154014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.154293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.154937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.157068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.160643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a715e-a879-415a-95f6-3506216608a6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.166351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.167276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.167666 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.168115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.168950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.171193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.181923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 797/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.182949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.192789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af62e1-413a-4234-8a37-47cffa895d34 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.197661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.198250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.198531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.198831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.199460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.201640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.212475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 798/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.213304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.218745 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:42.223869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029210-007b-4130-bb13-dae93aef93ea admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.228958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.229582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.229855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.234214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.234214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.234214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.242906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 799/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.243834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.253431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af099f-8b0e-4dda-9715-f4df5eda4982 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.259545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 799/1598] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:42 2022] POST /identity/v3/projects => generated 357 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:42.265194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.265194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.265417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.265499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.265499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.265499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.265499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.273981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 800/1599] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.275033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.284210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:42.286590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f5cb9-8157-4db5-a1b1-9b2f9b58f3af admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.332869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e93e0-7bdd-468c-b243-5335d7c681f3 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.337690 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.338346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.338618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.338925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] PATH_INFO: `/v3/projects/1c1772cbf744449891cae928448c57eb/users/61905bcad03541acb0a06f57b1c55795/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.345299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.346063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.346444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.346756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.347403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.349011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.355330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1772cbf744449891cae928448c57eb, user_id=61905bcad03541acb0a06f57b1c55795, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.358377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.359993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 801/1600] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.360820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.371409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f150b99-8884-46d0-a172-198522f598a1 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.376704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.377321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.377598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.377922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.378545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.380562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.462755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 800/1601] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:42 2022] PUT /identity/v3/projects/1c1772cbf744449891cae928448c57eb/users/61905bcad03541acb0a06f57b1c55795/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:42.463660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.491699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 802/1602] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:42 2022] POST /identity/v3/users => generated 312 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:42.492863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.503231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518566f-c622-4402-9c0f-d6185166baab admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.531247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52f27d-2a9e-43d8-88fc-7562ac272c7f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.536842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.537587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.537803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.538412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] PATH_INFO: `/v3/projects/75ecfc91f5d047d6aba3e42bd3b79869/users/a23157a4698e45438c333fcb3038e978/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.554108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ecfc91f5d047d6aba3e42bd3b79869, user_id=a23157a4698e45438c333fcb3038e978, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.556832 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.564515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.565185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.565464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.565737 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] PATH_INFO: `/v3/projects/648811a7a3104a3a99b17209a2d5540f/users/1d01a563cfc04332b58f6c786946ef65/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.582229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648811a7a3104a3a99b17209a2d5540f, user_id=1d01a563cfc04332b58f6c786946ef65, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.584983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.680308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 801/1603] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:42 2022] PUT /identity/v3/projects/75ecfc91f5d047d6aba3e42bd3b79869/users/a23157a4698e45438c333fcb3038e978/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:42.681943 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.699299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 803/1604] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:42 2022] PUT /identity/v3/projects/648811a7a3104a3a99b17209a2d5540f/users/1d01a563cfc04332b58f6c786946ef65/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:42.700130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.756423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:42.758293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d2df8-ce2e-47e7-8a79-711f6b77b579 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.774215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78557a3e-7f89-4968-9248-3d4dd8674754 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.779207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.779804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.780082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.780351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.781169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.783153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.791319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:42.822368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.823078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.823356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.823653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] PATH_INFO: `/v3/projects/940322f9e16148968e14207f13b73ff1/users/326a6b8a01684f5ebdf69fa0aa970f5a/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.837906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] RBAC: Authorizing `identity:create_grant(project_id=940322f9e16148968e14207f13b73ff1, user_id=326a6b8a01684f5ebdf69fa0aa970f5a, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.840625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.880525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 804/1605] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:42 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:42.881410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.891303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e48b2-5223-4dac-8128-c41be4716013 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.896859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 802/1606] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:42 2022] PUT /identity/v3/projects/940322f9e16148968e14207f13b73ff1/users/326a6b8a01684f5ebdf69fa0aa970f5a/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:42.897828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:42.964604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda08d5-6365-4ad9-875c-353a5c6ed0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.965410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda08d5-6365-4ad9-875c-353a5c6ed0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.965724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda08d5-6365-4ad9-875c-353a5c6ed0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.965974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda08d5-6365-4ad9-875c-353a5c6ed0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.966640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda08d5-6365-4ad9-875c-353a5c6ed0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:42.968268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda08d5-6365-4ad9-875c-353a5c6ed0d6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:42.978624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 805/1607] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:42.979982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e446c-ef77-42b2-a724-bad913a9ae46 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.980271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e446c-ef77-42b2-a724-bad913a9ae46 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.980668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e446c-ef77-42b2-a724-bad913a9ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:42.987181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e7a0e-5551-4355-b590-7e9bcf57882c admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:42.998015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5984eb1-12e3-4312-a7e6-b4e4ded1aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:42.998015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5984eb1-12e3-4312-a7e6-b4e4ded1aaa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:42.998541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5984eb1-12e3-4312-a7e6-b4e4ded1aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:42.998959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5984eb1-12e3-4312-a7e6-b4e4ded1aaa5 admin admin] PATH_INFO: `/v3/projects/580605cfe10a4696bf5a3a3159e601ec/users/231abaa35f914e799ec1bb2b4f7e40a8/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.003811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-136e446c-ef77-42b2-a724-bad913a9ae46 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:43.005006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-136e446c-ef77-42b2-a724-bad913a9ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:43.012927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 806/1608] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:43.013682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e446c-ef77-42b2-a724-bad913a9ae46 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.019693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5984eb1-12e3-4312-a7e6-b4e4ded1aaa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580605cfe10a4696bf5a3a3159e601ec, user_id=231abaa35f914e799ec1bb2b4f7e40a8, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.022652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5984eb1-12e3-4312-a7e6-b4e4ded1aaa5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.024552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e446c-ef77-42b2-a724-bad913a9ae46 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.030950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd4002-686e-4d95-a931-811c5b030da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.031560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd4002-686e-4d95-a931-811c5b030da2 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.031836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd4002-686e-4d95-a931-811c5b030da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.032131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd4002-686e-4d95-a931-811c5b030da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.032768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd4002-686e-4d95-a931-811c5b030da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.034369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd4002-686e-4d95-a931-811c5b030da2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.045315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 807/1609] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:43.046508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f79b1-3cf7-4dfd-9d21-b9f2ec6365be None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.046816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f79b1-3cf7-4dfd-9d21-b9f2ec6365be None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.047096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f79b1-3cf7-4dfd-9d21-b9f2ec6365be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.076644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-245f79b1-3cf7-4dfd-9d21-b9f2ec6365be None None] MFA Rules not processed for user `a23157a4698e45438c333fcb3038e978`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:43.077867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-245f79b1-3cf7-4dfd-9d21-b9f2ec6365be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:43.116035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 803/1610] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:42 2022] PUT /identity/v3/projects/580605cfe10a4696bf5a3a3159e601ec/users/231abaa35f914e799ec1bb2b4f7e40a8/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:43.118802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eff1a-5d4c-4464-89d4-d6bc80030f87 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.119944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eff1a-5d4c-4464-89d4-d6bc80030f87 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.120376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eff1a-5d4c-4464-89d4-d6bc80030f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.147586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 808/1611] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:43.148468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f79b1-3cf7-4dfd-9d21-b9f2ec6365be None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.152422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6f2eff1a-5d4c-4464-89d4-d6bc80030f87 None None] MFA Rules not processed for user `1d01a563cfc04332b58f6c786946ef65`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:43.154180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6f2eff1a-5d4c-4464-89d4-d6bc80030f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:43.169680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f79b1-3cf7-4dfd-9d21-b9f2ec6365be None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.210630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:43.229014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 804/1612] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:43.229014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.229014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.229014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.233651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.234282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.234560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.235145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.235887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.237488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.254281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 809/1613] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:43.254281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.260784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] MFA Rules not processed for user `326a6b8a01684f5ebdf69fa0aa970f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:43.262814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:43.262920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6dcb9-9d92-4f12-86a0-9e27895500c8 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.267134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.267736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.268012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.268280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] PATH_INFO: `/v3/projects/52816e5f52fd412794bd5361bc627a82/users/e1c7fbdb29a24a11b719fb59c8f57cc3/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.281122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:43.295192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=52816e5f52fd412794bd5361bc627a82, user_id=e1c7fbdb29a24a11b719fb59c8f57cc3, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.298021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.337124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 805/1614] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:43.338088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.339384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:43.383976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 810/1615] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:43 2022] PUT /identity/v3/projects/52816e5f52fd412794bd5361bc627a82/users/e1c7fbdb29a24a11b719fb59c8f57cc3/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:43.384866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.404829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb77f4c-db40-45ac-aede-ba9cdf6f54a5 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.476986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7864d7-3d5b-4e0d-9614-9dc8b7c2a23c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.479464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb445d4a-f839-4627-bbc8-d4703be4618c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.480158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb445d4a-f839-4627-bbc8-d4703be4618c service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.480491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb445d4a-f839-4627-bbc8-d4703be4618c service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.480931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb445d4a-f839-4627-bbc8-d4703be4618c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.484378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.485325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.485868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.486130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] PATH_INFO: `/v3/projects/226c7312e3d04b2ab186945fcedc388e/users/f00c8e4eb3394ff08cefb7619b7de485/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.494997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb445d4a-f839-4627-bbc8-d4703be4618c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.497514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb445d4a-f839-4627-bbc8-d4703be4618c service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.507416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] RBAC: Authorizing `identity:create_grant(project_id=226c7312e3d04b2ab186945fcedc388e, user_id=f00c8e4eb3394ff08cefb7619b7de485, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.509988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 806/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:43.510548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.511284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947dab1-e0ab-41ac-be54-003002576382 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.511565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947dab1-e0ab-41ac-be54-003002576382 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.511834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947dab1-e0ab-41ac-be54-003002576382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.533156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7947dab1-e0ab-41ac-be54-003002576382 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:43.534349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7947dab1-e0ab-41ac-be54-003002576382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:43.542248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 807/1617] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:43.543088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947dab1-e0ab-41ac-be54-003002576382 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.552747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947dab1-e0ab-41ac-be54-003002576382 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.556405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.557007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.557279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.557543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.568846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 811/1618] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:43 2022] PUT /identity/v3/projects/226c7312e3d04b2ab186945fcedc388e/users/f00c8e4eb3394ff08cefb7619b7de485/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:43.570048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.636245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.639570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.644615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0811b0-367f-4d23-92d4-306a504e591a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.649861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.650797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.651258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.651704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.652527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.655428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.658386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 808/1619] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:43.660485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.683659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5af39-f3f6-4363-949c-265dcca2daa1 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.696838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895dee7-e987-4d75-9653-bfeb4019ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.697926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895dee7-e987-4d75-9653-bfeb4019ca5e admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.698354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895dee7-e987-4d75-9653-bfeb4019ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.698865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895dee7-e987-4d75-9653-bfeb4019ca5e admin admin] PATH_INFO: `/v3/projects/e65cd2092d2a4d91a98e09e1d903847a/users/4743178c8d134a58a18ea1bb146d98c7/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.704710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:43.724458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895dee7-e987-4d75-9653-bfeb4019ca5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65cd2092d2a4d91a98e09e1d903847a, user_id=4743178c8d134a58a18ea1bb146d98c7, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.729297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895dee7-e987-4d75-9653-bfeb4019ca5e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.777053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 812/1620] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:43 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:43.777053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:43.798350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:43.836804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 809/1621] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:43 2022] PUT /identity/v3/projects/e65cd2092d2a4d91a98e09e1d903847a/users/4743178c8d134a58a18ea1bb146d98c7/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:43.841800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e722-2184-4cf5-bec3-7634e8549e46 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.842096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e722-2184-4cf5-bec3-7634e8549e46 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.842375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e722-2184-4cf5-bec3-7634e8549e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.845668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5d59-6c87-407d-99fc-9ba2c993c9fc admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:43.865000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e117e722-2184-4cf5-bec3-7634e8549e46 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:43.866514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e117e722-2184-4cf5-bec3-7634e8549e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:43.929621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:43.932285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:43.932530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:43.933294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:43.933549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:43.937347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:43.970057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 810/1622] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:43.970057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117e722-2184-4cf5-bec3-7634e8549e46 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.034555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117e722-2184-4cf5-bec3-7634e8549e46 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.039771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.044543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.044543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.044543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.045065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 813/1623] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:43 2022] POST /identity/v3/projects => generated 381 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:44.045065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.056773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.058521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.071462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 811/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:44.076497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.090016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18a808-d994-4658-8378-4969e7c49e6f service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.112440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ac115-ceb6-41d2-9f0b-883140d8dd9c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.117425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.118042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.118315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.118578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.119240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.120835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.144806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 814/1625] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:44.146001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.163959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85f337-67db-432f-9a27-6d422f923817 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.166281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.167056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.167348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.167732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.168664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.171221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.172789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.173532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.173936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.174306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.176001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.176810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.193945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 815/1626] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:44.201833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.244861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:44.263960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4225e-2a19-46eb-8dc5-6c2c4726f6a6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.270269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.270929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.276265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.276265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.282574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.284135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.296001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 816/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:44.296982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.305221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 812/1628] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:44 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:44.306336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.308333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b334d-6a46-4945-915e-b2bfef1511ab service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.314376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.315108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.315384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.315710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.316444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.318608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.327469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79518710-3bd7-4de4-947d-99140582d413 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.339066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.339894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.340887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.340887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] PATH_INFO: `/v3/projects/226c7312e3d04b2ab186945fcedc388e/users/f00c8e4eb3394ff08cefb7619b7de485/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.346177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=226c7312e3d04b2ab186945fcedc388e, user_id=f00c8e4eb3394ff08cefb7619b7de485, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.350311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.362764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 813/1629] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:44 2022] PUT /identity/v3/projects/226c7312e3d04b2ab186945fcedc388e/users/f00c8e4eb3394ff08cefb7619b7de485/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:44.363599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.373115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:44.424767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 817/1630] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:44 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:44.426725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.445486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9ce1-35bf-4555-af7c-2b6c1f884676 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.451345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e93ab0-a6b4-4dfc-a755-4afc24ec1ddd admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.454758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0d429-1fde-4bc8-927d-c6a5c6940fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.456144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d429-1fde-4bc8-927d-c6a5c6940fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.457061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d429-1fde-4bc8-927d-c6a5c6940fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.462657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d429-1fde-4bc8-927d-c6a5c6940fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.462657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d429-1fde-4bc8-927d-c6a5c6940fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.462947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.462947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.462947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.462947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] PATH_INFO: `/v3/projects/e65cd2092d2a4d91a98e09e1d903847a/users/4743178c8d134a58a18ea1bb146d98c7/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.463431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d429-1fde-4bc8-927d-c6a5c6940fc2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.464416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65cd2092d2a4d91a98e09e1d903847a, user_id=4743178c8d134a58a18ea1bb146d98c7, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.470259 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.486175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 818/1631] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:44.488782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 814/1632] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:44 2022] PUT /identity/v3/projects/e65cd2092d2a4d91a98e09e1d903847a/users/4743178c8d134a58a18ea1bb146d98c7/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:44.489201 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739396-d271-460b-a6ea-4d8801a33ea1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.489916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739396-d271-460b-a6ea-4d8801a33ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.490170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.491014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71739396-d271-460b-a6ea-4d8801a33ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.543109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-71739396-d271-460b-a6ea-4d8801a33ea1 None None] MFA Rules not processed for user `f00c8e4eb3394ff08cefb7619b7de485`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:44.546253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-71739396-d271-460b-a6ea-4d8801a33ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:44.601590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfe90c-c7b0-495f-ab3f-ab9406be1a7b admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.607847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.608458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.608873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.609758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.610075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.611907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.623914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 815/1633] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:44.624953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.636731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72924df7-6f87-4b9d-bd7f-aac70e12c132 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.642902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.643751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.644177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.644446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] PATH_INFO: `/v3/projects/a3d3582c1a2748a39bd203712bbb4f8a/users/0e5a725f606f4bd0a860f80aca40c54b/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.655718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 819/1634] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:44 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:44.657022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e23-f22e-4547-b518-821481914879 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.657601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e23-f22e-4547-b518-821481914879 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.657813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09e23-f22e-4547-b518-821481914879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.662511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d3582c1a2748a39bd203712bbb4f8a, user_id=0e5a725f606f4bd0a860f80aca40c54b, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.665316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.697875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-32e09e23-f22e-4547-b518-821481914879 None None] MFA Rules not processed for user `4743178c8d134a58a18ea1bb146d98c7`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:44.699489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-32e09e23-f22e-4547-b518-821481914879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:44.737985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 816/1635] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:44 2022] PUT /identity/v3/projects/a3d3582c1a2748a39bd203712bbb4f8a/users/0e5a725f606f4bd0a860f80aca40c54b/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:44.743749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.808130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 820/1636] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:44.808130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e23-f22e-4547-b518-821481914879 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:44.844505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:44.854531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b786-1741-4ba8-a0c7-44895ac4e3c9 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.859371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.860171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.860635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.860858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] PATH_INFO: `/v3/projects/9d81785be95c4c9aa02fa1dd2700ba3b/users/5e8d133b1dc04323826880694c7061d8/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.878361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d81785be95c4c9aa02fa1dd2700ba3b, user_id=5e8d133b1dc04323826880694c7061d8, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:44.881376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:44.885574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:44.893319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09e23-f22e-4547-b518-821481914879 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:44.948232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:44.948902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:44.949188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:44.949472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:44.983947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 817/1637] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:44 2022] PUT /identity/v3/projects/9d81785be95c4c9aa02fa1dd2700ba3b/users/5e8d133b1dc04323826880694c7061d8/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:44.984939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.029934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.031644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.041796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 821/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:45.048241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.054074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb94bca-fbb2-4e00-ad7f-e9b0d815fc66 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.060720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.061135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.061419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.061841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.062534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.064397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.075734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 818/1639] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:45.076938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.088747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea2e81-e719-462a-a187-93d193ba2487 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.093537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.094141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.094420 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.094709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.095451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.097071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.109576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 819/1640] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:45.109576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.120661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d797995-8147-4ac2-8b9c-97fcd4488fcf admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.126576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.128299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.128299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.128299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] PATH_INFO: `/v3/projects/a3d3582c1a2748a39bd203712bbb4f8a/users/0e5a725f606f4bd0a860f80aca40c54b/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.130196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d3582c1a2748a39bd203712bbb4f8a, user_id=0e5a725f606f4bd0a860f80aca40c54b, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.133365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.151648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7f45-18b0-4f27-9979-9ab57d2a8b92 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.156833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 820/1641] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:45 2022] PUT /identity/v3/projects/a3d3582c1a2748a39bd203712bbb4f8a/users/0e5a725f606f4bd0a860f80aca40c54b/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:45.157652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.257655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:45.279745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11360b7f-411a-47d9-a4f6-eac4e3447206 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.282249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac844866-f054-4ebe-a7a5-07990d89f068 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4743178c8d134a58a18ea1bb146d98c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e65cd2092d2a4d91a98e09e1d903847a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.283036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844866-f054-4ebe-a7a5-07990d89f068 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.283467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844866-f054-4ebe-a7a5-07990d89f068 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.283757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844866-f054-4ebe-a7a5-07990d89f068 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.284899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844866-f054-4ebe-a7a5-07990d89f068 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:45.285242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844866-f054-4ebe-a7a5-07990d89f068 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.287363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.288031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac844866-f054-4ebe-a7a5-07990d89f068 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.289014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.289014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.289666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] PATH_INFO: `/v3/projects/9d81785be95c4c9aa02fa1dd2700ba3b/users/5e8d133b1dc04323826880694c7061d8/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.293295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d81785be95c4c9aa02fa1dd2700ba3b, user_id=5e8d133b1dc04323826880694c7061d8, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.296609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.308132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 822/1642] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:45.310460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dee9b1-0770-45e4-8c78-e94b4d2a3362 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.310986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dee9b1-0770-45e4-8c78-e94b4d2a3362 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.311211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dee9b1-0770-45e4-8c78-e94b4d2a3362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.314660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 821/1643] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:45 2022] PUT /identity/v3/projects/9d81785be95c4c9aa02fa1dd2700ba3b/users/5e8d133b1dc04323826880694c7061d8/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:45.315864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.359552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b6dee9b1-0770-45e4-8c78-e94b4d2a3362 None None] MFA Rules not processed for user `0e5a725f606f4bd0a860f80aca40c54b`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:45.360920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b6dee9b1-0770-45e4-8c78-e94b4d2a3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:45.439270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f955-3ce1-44f0-88ef-3e22d019715b admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.447539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4743178c8d134a58a18ea1bb146d98c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e65cd2092d2a4d91a98e09e1d903847a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.448165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.448449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.448723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.449655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.452378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.458937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:45.469015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 823/1644] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:45.473352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bf4b8-ff9f-4388-8227-a74909604f09 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.473352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bf4b8-ff9f-4388-8227-a74909604f09 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.473596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bf4b8-ff9f-4388-8227-a74909604f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.531464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b71bf4b8-ff9f-4388-8227-a74909604f09 None None] MFA Rules not processed for user `5e8d133b1dc04323826880694c7061d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:45.531464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b71bf4b8-ff9f-4388-8227-a74909604f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:45.581168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 822/1645] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:45 2022] POST /identity/v3/projects => generated 349 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:45.581168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.647887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 824/1646] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:45.649447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bf4b8-ff9f-4388-8227-a74909604f09 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.650649 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548988e9-8f8c-45e9-8ce5-bf5d2c5cf7e8 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.655476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5a725f606f4bd0a860f80aca40c54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3582c1a2748a39bd203712bbb4f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.656138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.656416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.656710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.657439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:45.657740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.659433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.661373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bf4b8-ff9f-4388-8227-a74909604f09 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.679429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 823/1647] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:45.679429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.705584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:45.723564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4743178c8d134a58a18ea1bb146d98c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e65cd2092d2a4d91a98e09e1d903847a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.724177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.724458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.724733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.725436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:45.725718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.727368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.739325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 825/1648] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:45.740142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.745988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2620-5a75-4129-859f-2d80ac7e500c tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.753497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.753625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de27959-8561-4870-a7ff-3e473149b4e7 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.754027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.754440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.754823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.758622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5a725f606f4bd0a860f80aca40c54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3582c1a2748a39bd203712bbb4f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.761122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.761408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.761757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.762378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.764389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.816267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.818096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.828335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 824/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:45.834220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.838745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2ce40-e803-4331-b7ec-fe119313f6da service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.842900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.843609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.843890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.844161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.861384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 826/1650] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:45 2022] POST /identity/v3/projects => generated 349 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:45.866182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:45.879835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:45.882868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:45.910788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 825/1651] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:45.985491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d19ac-3dee-4538-a3b3-43b290f23688 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:45.994092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5a725f606f4bd0a860f80aca40c54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3582c1a2748a39bd203712bbb4f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:45.994982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:45.995346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:45.995731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:45.997277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:45.997721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:46.000382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:46.018324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 827/1652] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:46.037906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:46.046624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a561-3e15-42c2-b646-baf78ab8df9d service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:46.117313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:46.118134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:46.118490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:46.119030 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:46.136925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:46.139204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:46.146957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:46.158364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 826/1653] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:46.820506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:46.844169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:46.845372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef510d9-2425-4f85-8f6b-dd62326327a6 tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:46.851071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:46.851975 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:46.852325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:46.852707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:46.979978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c94f7f-d682-4967-a2a5-5eb686faf195 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:46.985185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4743178c8d134a58a18ea1bb146d98c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e65cd2092d2a4d91a98e09e1d903847a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:46.986214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:46.986214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:46.986387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] PATH_INFO: `/v3/projects/6ceae53a32c540f9b5f6088881e6eef5` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:46.988238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6ceae53a32c540f9b5f6088881e6eef5)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:46.989284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING py.warnings [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:46.989284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: warnings.warn(msg) Oct 28 09:54:46.989284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: Oct 28 09:54:46.990486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:46.991968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:46.996015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:47.041917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 828/1654] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:47.240110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ceae53a32c540f9b5f6088881e6eef5', 'request_id': 'req-bcc303ad-983b-4942-9664-d82a4cc10501'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:47.325813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ceae53a32c540f9b5f6088881e6eef5', 'request_id': 'req-bcc303ad-983b-4942-9664-d82a4cc10501'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:47.337733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ceae53a32c540f9b5f6088881e6eef5', 'request_id': 'req-bcc303ad-983b-4942-9664-d82a4cc10501'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:47.380732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] The token cache is being invalidate because project 6ceae53a32c540f9b5f6088881e6eef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:47.381083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:47.381908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-bcc303ad-983b-4942-9664-d82a4cc10501 tempest-QuotasTest-1478857596 tempest-QuotasTest-1478857596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:47.385719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 827/1655] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:46 2022] DELETE /identity/v3/projects/6ceae53a32c540f9b5f6088881e6eef5 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:54:48.234817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:48.337612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:48.389076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d0851-b6eb-44ed-ab5a-9452d8235b7e service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:48.527189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:48.527189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:48.527662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:48.528528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] PATH_INFO: `/v3/users/d68034a487c9438cbee62386724db1e1` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:48.533566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68034a487c9438cbee62386724db1e1)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:48.535316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: WARNING py.warnings [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:48.535316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: warnings.warn(msg) Oct 28 09:54:48.535316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: Oct 28 09:54:48.544843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:48.827138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68034a487c9438cbee62386724db1e1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:48.892335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68034a487c9438cbee62386724db1e1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:48.892998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68034a487c9438cbee62386724db1e1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:48.914636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68034a487c9438cbee62386724db1e1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:48.954557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68034a487c9438cbee62386724db1e1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:48.979861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 829/1656] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:48 2022] DELETE /identity/v3/users/d68034a487c9438cbee62386724db1e1 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:48.984929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:48.985449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:48.985449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:49.019494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:49.021266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:49.109000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:49.139138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 828/1657] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:49.175992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:49.181809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:49.283274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf545a-9c6d-431c-8e10-ca9338ae1428 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:49.289214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8dcfa-a4ec-45b7-ae5e-bd297e6c79e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:49.290197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8dcfa-a4ec-45b7-ae5e-bd297e6c79e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:49.290708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8dcfa-a4ec-45b7-ae5e-bd297e6c79e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:49.291325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8dcfa-a4ec-45b7-ae5e-bd297e6c79e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:49.309683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8dcfa-a4ec-45b7-ae5e-bd297e6c79e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:49.312075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8dcfa-a4ec-45b7-ae5e-bd297e6c79e0 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:49.326876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 830/1658] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:49.645359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:49.647025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:49.668935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acba907-49f1-4c89-b97f-1b31e2d60230 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:49.684065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:49.684811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:49.685083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:49.685310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] PATH_INFO: `/v3/users/c406b078597340fd9424f246834eef69` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:49.690608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c406b078597340fd9424f246834eef69)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:49.698448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:49.961478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c406b078597340fd9424f246834eef69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:50.040590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c406b078597340fd9424f246834eef69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:50.065629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c406b078597340fd9424f246834eef69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:50.067980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c406b078597340fd9424f246834eef69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:50.115446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020a5070-818d-452b-919d-7a9f8ae645e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c406b078597340fd9424f246834eef69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:50.138484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33720-3dbb-4075-bbe4-37f2baf6dbd4 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.150181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33720-3dbb-4075-bbe4-37f2baf6dbd4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.151276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33720-3dbb-4075-bbe4-37f2baf6dbd4 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.154874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 831/1659] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:54:50 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 09:54:50.166167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 829/1660] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:49 2022] DELETE /identity/v3/users/c406b078597340fd9424f246834eef69 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:50.176761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.177070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.177426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.223393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:50.223767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0879-2a0d-4148-8e80-973986f011cd None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.242029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0879-2a0d-4148-8e80-973986f011cd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.242507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0879-2a0d-4148-8e80-973986f011cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.244181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:50.249059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:50.276156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-aa2d0879-2a0d-4148-8e80-973986f011cd None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:50.281510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-aa2d0879-2a0d-4148-8e80-973986f011cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:50.335795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 832/1661] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:50.377241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:50.379534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:50.461539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 830/1662] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:50.487680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d8a3-feda-4483-8bf4-7dde9839ddc0 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:50.495650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97b8e9-b13f-457c-86fc-3d61d56517e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:50.497139 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b8e9-b13f-457c-86fc-3d61d56517e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.497738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b8e9-b13f-457c-86fc-3d61d56517e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.509961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b8e9-b13f-457c-86fc-3d61d56517e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.522226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b8e9-b13f-457c-86fc-3d61d56517e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:50.525166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b8e9-b13f-457c-86fc-3d61d56517e7 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:50.538346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 833/1663] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:54:50.549389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3b19b-bacc-4097-a10a-9e246a3e7438 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.549801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3b19b-bacc-4097-a10a-9e246a3e7438 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.550187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3b19b-bacc-4097-a10a-9e246a3e7438 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.551980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 831/1664] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:54:50.583035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a5ee-deaf-4049-b6d0-804e57bd7300 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.584388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a5ee-deaf-4049-b6d0-804e57bd7300 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.585062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a5ee-deaf-4049-b6d0-804e57bd7300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.593212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3b19b-bacc-4097-a10a-9e246a3e7438 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:50.597503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1fa3b19b-bacc-4097-a10a-9e246a3e7438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:50.683074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9238a5ee-deaf-4049-b6d0-804e57bd7300 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:50.685947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9238a5ee-deaf-4049-b6d0-804e57bd7300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:50.698026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3b19b-bacc-4097-a10a-9e246a3e7438 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:50.699049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 834/1665] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:50.706398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:50.708019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.708678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.709105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.719581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1380-2474-4f9f-b6d8-2d074fdf261d None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.720232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1380-2474-4f9f-b6d8-2d074fdf261d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.720808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd1380-2474-4f9f-b6d8-2d074fdf261d None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.723208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 835/1666] 10.222.0.49 () {54 vars in 961 bytes} [Fri Oct 28 09:54:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:54:50.728538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:50.734271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.735253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.736041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.749503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:50.802291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 832/1667] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:54:50.804679 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:50.806958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:50.825253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 836/1668] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Oct 28 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:50.834376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:50.855799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adeb952-735d-45db-9f90-0d926fc08d81 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:50.870095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:50.872036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:50.872414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:50.873810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:50.902198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:50.905958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:50.928442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 833/1669] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:50.987233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:50.990273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:51.024161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f2493-ef92-41ce-a337-b17aea238d93 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:51.032028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:51.032688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:51.033210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:51.033973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] PATH_INFO: `/v3/projects/09bc2a00a0b243cdae9197b85a8b18d2` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:51.035468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bc2a00a0b243cdae9197b85a8b18d2)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:51.038217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:51.206095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bc2a00a0b243cdae9197b85a8b18d2', 'request_id': 'req-ae572f91-ad9a-419e-bd16-642bf44d1988'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.326758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bc2a00a0b243cdae9197b85a8b18d2', 'request_id': 'req-ae572f91-ad9a-419e-bd16-642bf44d1988'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.342619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bc2a00a0b243cdae9197b85a8b18d2', 'request_id': 'req-ae572f91-ad9a-419e-bd16-642bf44d1988'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.386717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] The token cache is being invalidate because project 09bc2a00a0b243cdae9197b85a8b18d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:51.387596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.393700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.398996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 837/1670] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:50 2022] DELETE /identity/v3/projects/09bc2a00a0b243cdae9197b85a8b18d2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:51.402933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:51.427223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d2952-fdd0-4fd4-9f19-f2b5f9c9606b service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:51.521815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:51.574547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:51.575736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:51.576025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:51.586241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] PATH_INFO: `/v3/users/4743178c8d134a58a18ea1bb146d98c7` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:51.586241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4743178c8d134a58a18ea1bb146d98c7)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:51.586241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:51.821428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4743178c8d134a58a18ea1bb146d98c7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.882346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:51.883972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:51.903592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4743178c8d134a58a18ea1bb146d98c7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.906885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae572f91-ad9a-419e-bd16-642bf44d1988 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:51.918524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:51.919215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:51.919495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:51.919766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] PATH_INFO: `/v3/projects/722b078fbcd543f8803c68728149244d` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:51.931618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=722b078fbcd543f8803c68728149244d)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:51.933806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:51.935290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4743178c8d134a58a18ea1bb146d98c7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.937328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4743178c8d134a58a18ea1bb146d98c7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.957954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:51.974313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4743178c8d134a58a18ea1bb146d98c7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:51.992611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 834/1671] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:51 2022] DELETE /identity/v3/users/4743178c8d134a58a18ea1bb146d98c7 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:52.082961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722b078fbcd543f8803c68728149244d', 'request_id': 'req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.205043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722b078fbcd543f8803c68728149244d', 'request_id': 'req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.214409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722b078fbcd543f8803c68728149244d', 'request_id': 'req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.233382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] The token cache is being invalidate because project 722b078fbcd543f8803c68728149244d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:52.233898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.242217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.249046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 838/1672] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:51 2022] DELETE /identity/v3/projects/722b078fbcd543f8803c68728149244d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:52.252130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:52.255338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:52.390915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd7f8-7c45-4898-85ed-6018fc2a221d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:52.506445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:52.508991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:52.509582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:52.510506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] PATH_INFO: `/v3/users/f00c8e4eb3394ff08cefb7619b7de485` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:52.513094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00c8e4eb3394ff08cefb7619b7de485)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:52.516970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:52.522922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:52.782093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:52.784252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:52.801737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00c8e4eb3394ff08cefb7619b7de485'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.897827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00c8e4eb3394ff08cefb7619b7de485'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.922430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00c8e4eb3394ff08cefb7619b7de485'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.923641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00c8e4eb3394ff08cefb7619b7de485'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.934250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00c8e4eb3394ff08cefb7619b7de485'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:52.944172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 835/1673] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:52 2022] DELETE /identity/v3/users/f00c8e4eb3394ff08cefb7619b7de485 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:52.969265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7682cda-aca5-4ba1-9ad9-ca4bb587c7d3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:53.062343 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e5a725f606f4bd0a860f80aca40c54b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3d3582c1a2748a39bd203712bbb4f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:53.063523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:53.063984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:53.064454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] PATH_INFO: `/v3/projects/5260f5d000eb40f689cb5f59ca14a50f` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:53.066781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5260f5d000eb40f689cb5f59ca14a50f)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:53.069361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:53.260127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5260f5d000eb40f689cb5f59ca14a50f', 'request_id': 'req-167f8f37-cc92-4d8b-a521-cd4bc167fbca'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.267685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:53.347762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5260f5d000eb40f689cb5f59ca14a50f', 'request_id': 'req-167f8f37-cc92-4d8b-a521-cd4bc167fbca'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.354619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5260f5d000eb40f689cb5f59ca14a50f', 'request_id': 'req-167f8f37-cc92-4d8b-a521-cd4bc167fbca'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.380672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] The token cache is being invalidate because project 5260f5d000eb40f689cb5f59ca14a50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:53.381006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.386378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.392084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 839/1674] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:52 2022] DELETE /identity/v3/projects/5260f5d000eb40f689cb5f59ca14a50f => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:53.392921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:53.395059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:53.540002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a27c-1193-478e-82a2-7fe5271c71d9 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:53.611474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:53.612133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:53.612548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:53.612815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] PATH_INFO: `/v3/users/1d01a563cfc04332b58f6c786946ef65` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:53.614223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d01a563cfc04332b58f6c786946ef65)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:53.617680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:53.674516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:53.678149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:53.716154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f8f37-cc92-4d8b-a521-cd4bc167fbca tempest-QuotasNegativeTest-1617062988 tempest-QuotasNegativeTest-1617062988-project-admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:53.720699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:53.721543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:53.722034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:53.722365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] PATH_INFO: `/v3/projects/226c7312e3d04b2ab186945fcedc388e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:53.723628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226c7312e3d04b2ab186945fcedc388e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:53.726001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:53.869891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d01a563cfc04332b58f6c786946ef65'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.874714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226c7312e3d04b2ab186945fcedc388e', 'request_id': 'req-a52667af-03a4-417d-ba86-f61fd52d47d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.896926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:53.947919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226c7312e3d04b2ab186945fcedc388e', 'request_id': 'req-a52667af-03a4-417d-ba86-f61fd52d47d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.957818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226c7312e3d04b2ab186945fcedc388e', 'request_id': 'req-a52667af-03a4-417d-ba86-f61fd52d47d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.989515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] The token cache is being invalidate because project 226c7312e3d04b2ab186945fcedc388e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:53.989865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.990730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:53.992968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 840/1675] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:53 2022] DELETE /identity/v3/projects/226c7312e3d04b2ab186945fcedc388e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:53.993685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:53.998527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.010550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d01a563cfc04332b58f6c786946ef65'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.034869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d01a563cfc04332b58f6c786946ef65'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.035738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d01a563cfc04332b58f6c786946ef65'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.048385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-01a5d773-e332-439d-9f37-cc4fa9bc8606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d01a563cfc04332b58f6c786946ef65'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.070069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 836/1676] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:53 2022] DELETE /identity/v3/users/1d01a563cfc04332b58f6c786946ef65 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:54:54.071947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf0f5d-be6b-42c3-83fb-0c313de9d52f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.074220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf0f5d-be6b-42c3-83fb-0c313de9d52f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.077440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf0f5d-be6b-42c3-83fb-0c313de9d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.116720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-15bf0f5d-be6b-42c3-83fb-0c313de9d52f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:54.118470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-15bf0f5d-be6b-42c3-83fb-0c313de9d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.135808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52667af-03a4-417d-ba86-f61fd52d47d9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:54.281709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 837/1677] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:54.283586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bef6a9-e2cb-408e-b71f-eb28bb4b53e6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.288550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bef6a9-e2cb-408e-b71f-eb28bb4b53e6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.290756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bef6a9-e2cb-408e-b71f-eb28bb4b53e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.291324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:54.292111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.292391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.292665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] PATH_INFO: `/v3/projects/e65cd2092d2a4d91a98e09e1d903847a` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.294804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65cd2092d2a4d91a98e09e1d903847a)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:54.297226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:54.360614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-30bef6a9-e2cb-408e-b71f-eb28bb4b53e6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:54.362315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-30bef6a9-e2cb-408e-b71f-eb28bb4b53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.392100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 838/1678] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:54.395595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e157a4-b611-433c-b2a0-53fc530bc00a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.396180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e157a4-b611-433c-b2a0-53fc530bc00a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.396947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e157a4-b611-433c-b2a0-53fc530bc00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.440502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-61e157a4-b611-433c-b2a0-53fc530bc00a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:54.445017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-61e157a4-b611-433c-b2a0-53fc530bc00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.451614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65cd2092d2a4d91a98e09e1d903847a', 'request_id': 'req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.492277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:54.507749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65cd2092d2a4d91a98e09e1d903847a', 'request_id': 'req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.519446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65cd2092d2a4d91a98e09e1d903847a', 'request_id': 'req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.542122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] The token cache is being invalidate because project e65cd2092d2a4d91a98e09e1d903847a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:54.542450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.543436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:54.546814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 841/1679] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:53 2022] DELETE /identity/v3/projects/e65cd2092d2a4d91a98e09e1d903847a => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:54.547331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:54.549467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.602736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 839/1680] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:54.606783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00380b-cdd5-4070-9954-6c3106add683 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.607288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00380b-cdd5-4070-9954-6c3106add683 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.608743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00380b-cdd5-4070-9954-6c3106add683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.638719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c84a92-72ab-44fe-91d1-7da64e6a2aeb admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:54.642744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c04be0-5c6e-417b-b45e-d9d954fc0a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:54.644243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04be0-5c6e-417b-b45e-d9d954fc0a94 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.650845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04be0-5c6e-417b-b45e-d9d954fc0a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.658015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c04be0-5c6e-417b-b45e-d9d954fc0a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.658015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-90c04be0-5c6e-417b-b45e-d9d954fc0a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.661526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4b00380b-cdd5-4070-9954-6c3106add683 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:54.662907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4b00380b-cdd5-4070-9954-6c3106add683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.675219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 840/1681] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:54.676574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00380b-cdd5-4070-9954-6c3106add683 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:54.687929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c04be0-5c6e-417b-b45e-d9d954fc0a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:54.689405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c04be0-5c6e-417b-b45e-d9d954fc0a94 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:54.692451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00380b-cdd5-4070-9954-6c3106add683 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:54.700864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:54.701854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.702278 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.702808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.703788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:54.704580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:54.706474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:54.707932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 842/1682] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:54.709235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb915dd-5906-4141-9aa3-ef32a7459e4c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.709521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb915dd-5906-4141-9aa3-ef32a7459e4c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.709791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb915dd-5906-4141-9aa3-ef32a7459e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.732707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 841/1683] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:54.735738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:54.756573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-deb915dd-5906-4141-9aa3-ef32a7459e4c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:54.757802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-deb915dd-5906-4141-9aa3-ef32a7459e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:54.761053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b5a10-ae7a-4807-8551-24bbfa316fb6 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:54.767123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:54.768585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.768585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.768888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.769988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:54.773686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:54.774791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 843/1684] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:54.778821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb915dd-5906-4141-9aa3-ef32a7459e4c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:54.797146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb915dd-5906-4141-9aa3-ef32a7459e4c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:54.811792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:54.813427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.813427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.813427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.813427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:54:54.813703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:54.815496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:54.831977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 844/1685] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:54:54.836364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:54.851947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee8958-6f2e-4e4e-8bfe-ec1442139c43 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:54.864625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:54.866485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:54.866998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:54.867408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:54.868402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:54.871155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:54.906493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 842/1686] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:54.910637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.045257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 845/1687] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:54:55.046295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.056560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:55.086225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec045a-4fb5-44e2-bf33-a125858313fc admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.225189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781255b9-784e-4c97-83cd-ec33c161ed70 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.232476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.233646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.235375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.236092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.237576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.237772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.238316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.238591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.238892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.239627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.241147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.242564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.354861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 843/1688] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:54 2022] POST /identity/v3/users => generated 293 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:55.362069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.372332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 846/1689] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:55 2022] POST /identity/v3/users => generated 289 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:55.383107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.383244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08220288-126c-4d6d-9380-bd4fc85c64ad admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.398388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c28802-8678-4372-a89d-d203b30a772a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.398858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.399719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.400098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.403865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.403865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.405573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.410338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.411032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.411312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.411584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.412233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.415144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.425075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 844/1690] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:54:55.441336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 847/1691] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:54:55.442322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.464318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69ad94-dbf1-4769-aca6-753b1dbcc6c3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.476176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.476737 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.477472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.477472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.478089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.481696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.487931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.514730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5fa2-014a-4b74-b46b-e9b53d82723a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.522784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 848/1692] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:55.526244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.527246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.528401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.528680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.533988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.534798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.538011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.547719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9361b-c446-4057-8cad-66e1d8402652 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.560008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa8780-4fd6-4f51-a00b-af23120a256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.560506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8780-4fd6-4f51-a00b-af23120a256c admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.560783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8780-4fd6-4f51-a00b-af23120a256c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.561057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa8780-4fd6-4f51-a00b-af23120a256c admin admin] PATH_INFO: `/v3/projects/23b55469f48b4870b1e2c57a1aa8de60/users/b205ccf553044988befaf5421aac5e36/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.561845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 845/1693] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:55.562779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:55.586521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732406c6-e4e7-43e9-9b1b-15393eaca40d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:55.594121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8780-4fd6-4f51-a00b-af23120a256c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b55469f48b4870b1e2c57a1aa8de60, user_id=b205ccf553044988befaf5421aac5e36, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.597669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c0639-e2bc-47c6-94a5-b8605bc8913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:55.599445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0639-e2bc-47c6-94a5-b8605bc8913e admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.599722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0639-e2bc-47c6-94a5-b8605bc8913e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.600411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c0639-e2bc-47c6-94a5-b8605bc8913e admin admin] PATH_INFO: `/v3/projects/6194e966f5634b5f990337e68ff12a0e/users/d714d879eea84852a748a5a44a777ec7/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.600606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa8780-4fd6-4f51-a00b-af23120a256c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.607173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:55.623776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0639-e2bc-47c6-94a5-b8605bc8913e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6194e966f5634b5f990337e68ff12a0e, user_id=d714d879eea84852a748a5a44a777ec7, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:55.626140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c0639-e2bc-47c6-94a5-b8605bc8913e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:55.741512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 846/1694] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:55 2022] PUT /identity/v3/projects/6194e966f5634b5f990337e68ff12a0e/users/d714d879eea84852a748a5a44a777ec7/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:55.742650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 849/1695] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:55 2022] PUT /identity/v3/projects/23b55469f48b4870b1e2c57a1aa8de60/users/b205ccf553044988befaf5421aac5e36/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:55.755091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4404d5a-b0b6-4ad0-853a-bcbe10c30bc0 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.756302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beea8f-72d7-4e2c-a1c5-cfb86a9e751c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:55.757792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4404d5a-b0b6-4ad0-853a-bcbe10c30bc0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.757792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4404d5a-b0b6-4ad0-853a-bcbe10c30bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.759158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beea8f-72d7-4e2c-a1c5-cfb86a9e751c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:55.759609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8beea8f-72d7-4e2c-a1c5-cfb86a9e751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:55.917661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f4404d5a-b0b6-4ad0-853a-bcbe10c30bc0 None None] MFA Rules not processed for user `d714d879eea84852a748a5a44a777ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:55.919899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b8beea8f-72d7-4e2c-a1c5-cfb86a9e751c None None] MFA Rules not processed for user `b205ccf553044988befaf5421aac5e36`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:55.921143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b8beea8f-72d7-4e2c-a1c5-cfb86a9e751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:55.926830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f4404d5a-b0b6-4ad0-853a-bcbe10c30bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:56.121767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 850/1696] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:56.125308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8beea8f-72d7-4e2c-a1c5-cfb86a9e751c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:56.159130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:56.167221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 847/1697] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:56.171760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4404d5a-b0b6-4ad0-853a-bcbe10c30bc0 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:56.253105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8beea8f-72d7-4e2c-a1c5-cfb86a9e751c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:56.276603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:56.278474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.278948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.279381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.280475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:56.284246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:56.407321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4404d5a-b0b6-4ad0-853a-bcbe10c30bc0 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:56.421249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:56.421249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.421686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.422263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.422560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:56.427520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 851/1698] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:56 2022] POST /identity/v3/projects => generated 377 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:56.431661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:56.443755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:56.534157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:56.609869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 848/1699] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:54:56 2022] POST /identity/v3/projects => generated 383 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:56.613820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:56.654764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77739a88-8609-4558-9e8e-3f8223532ec9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:56.848507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee7840-4878-4601-932a-448af6df297e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:56.856808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:56.857952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.858446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.859076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.860626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:56.867312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:56.870929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:56.874235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:56.874956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:56.876740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:56.883112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:56.893163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:56.998700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 849/1700] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:56 2022] POST /identity/v3/users => generated 298 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:54:57.000022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.007406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 852/1701] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:54:56 2022] POST /identity/v3/users => generated 295 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:54:57.008049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:57.012285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.031989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcfb52-ccdd-4c70-a343-107629e84963 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.049791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df69ad2-a3bf-4999-afb6-c07188f0423d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.050413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.051227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.051608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.051986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] PATH_INFO: `/v3/projects/648811a7a3104a3a99b17209a2d5540f` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.055514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=648811a7a3104a3a99b17209a2d5540f)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.057970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.063177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.063936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.064227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.064566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.066365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.069332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.116570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 853/1702] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:57.120090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.156588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf796f1e-bbe7-4022-b4a6-c701ca35a0c8 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.177490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.179207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.179641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.180052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.181306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.185225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.224599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 854/1703] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:57.225974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.239346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42207a6c-ee7d-476f-a92e-7f36dab605d9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.253550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648811a7a3104a3a99b17209a2d5540f', 'request_id': 'req-08c1466d-de6d-405d-bc1b-47bd9871c96b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:57.259111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:57.336631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648811a7a3104a3a99b17209a2d5540f', 'request_id': 'req-08c1466d-de6d-405d-bc1b-47bd9871c96b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:57.343011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648811a7a3104a3a99b17209a2d5540f', 'request_id': 'req-08c1466d-de6d-405d-bc1b-47bd9871c96b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:57.354392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.355542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.355891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.356235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] PATH_INFO: `/v3/projects/eafddc094402409aa26f4d30d57ce49a/users/0b52d2c152c34737a181dcf65a387def/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.366822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] The token cache is being invalidate because project 648811a7a3104a3a99b17209a2d5540f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:54:57.366822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:57.367170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:57.372593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 850/1704] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:56 2022] DELETE /identity/v3/projects/648811a7a3104a3a99b17209a2d5540f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:57.373441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.376775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:57.391129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafddc094402409aa26f4d30d57ce49a, user_id=0b52d2c152c34737a181dcf65a387def, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.394721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.410026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1466d-de6d-405d-bc1b-47bd9871c96b admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.415236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.415966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.416204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.416460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] PATH_INFO: `/v3/projects/fafff247268b48ddb6f898503ef047cc/users/b8170812dd1b4c20bb07d3ac6a86d998/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.450498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafff247268b48ddb6f898503ef047cc, user_id=b8170812dd1b4c20bb07d3ac6a86d998, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.453681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.485788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 855/1705] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:57 2022] PUT /identity/v3/projects/eafddc094402409aa26f4d30d57ce49a/users/0b52d2c152c34737a181dcf65a387def/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:57.486844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.492569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:57.539427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:57.556988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 851/1706] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:57 2022] PUT /identity/v3/projects/fafff247268b48ddb6f898503ef047cc/users/b8170812dd1b4c20bb07d3ac6a86d998/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:57.556988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.571618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:57.658769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b641f9a-f226-4858-96b0-75a0ab52cade admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.719290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b731ff-09df-495f-bd5e-c004b45208dc admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.731207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.732186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.732678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.733013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.733741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.735530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.748223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 852/1707] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:57.752545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.762409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048010f-22cc-4933-a3ef-3bd03a93193a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.782337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.784753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.784753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.784753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.784753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.785978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.818517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 853/1708] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:54:57.818517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:57.836986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3bdbe-cf9a-4ac4-ab53-6e10df241f39 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:57.838556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.839286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.840302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.840614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] PATH_INFO: `/v3/users/0e5a725f606f4bd0a860f80aca40c54b` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.842826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5a725f606f4bd0a860f80aca40c54b)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.844791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.859519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:57.861021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:57.861228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:57.861662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] PATH_INFO: `/v3/projects/eafddc094402409aa26f4d30d57ce49a/users/0b52d2c152c34737a181dcf65a387def/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:57.865599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafddc094402409aa26f4d30d57ce49a, user_id=0b52d2c152c34737a181dcf65a387def, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:57.868686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:57.903863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 854/1709] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:57 2022] PUT /identity/v3/projects/eafddc094402409aa26f4d30d57ce49a/users/0b52d2c152c34737a181dcf65a387def/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:57.904961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.033310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6755b2-8d59-4bd7-bcfa-e0b9a7604962 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:58.043852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cef93-0325-4fc7-8f3d-6e3077f1c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:58.044464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cef93-0325-4fc7-8f3d-6e3077f1c960 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.044747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cef93-0325-4fc7-8f3d-6e3077f1c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.045061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cef93-0325-4fc7-8f3d-6e3077f1c960 admin admin] PATH_INFO: `/v3/projects/fafff247268b48ddb6f898503ef047cc/users/b8170812dd1b4c20bb07d3ac6a86d998/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.049785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cef93-0325-4fc7-8f3d-6e3077f1c960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafff247268b48ddb6f898503ef047cc, user_id=b8170812dd1b4c20bb07d3ac6a86d998, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:58.056174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cef93-0325-4fc7-8f3d-6e3077f1c960 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:58.066496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5a725f606f4bd0a860f80aca40c54b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:58.080046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 855/1710] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:54:57 2022] PUT /identity/v3/projects/fafff247268b48ddb6f898503ef047cc/users/b8170812dd1b4c20bb07d3ac6a86d998/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:58.083201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.087664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.087664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.164925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5a725f606f4bd0a860f80aca40c54b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:58.165773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5a725f606f4bd0a860f80aca40c54b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:58.172513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] MFA Rules not processed for user `0b52d2c152c34737a181dcf65a387def`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:58.174761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:58.176304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5a725f606f4bd0a860f80aca40c54b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:58.202247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:58.210529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-3da1473c-968c-4dc2-a03c-be244b72ad12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5a725f606f4bd0a860f80aca40c54b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:54:58.242327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 856/1711] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:54:57 2022] DELETE /identity/v3/users/0e5a725f606f4bd0a860f80aca40c54b => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:54:58.243050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb449cb-9b49-4b52-9c1b-5ab03d215f46 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.243335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb449cb-9b49-4b52-9c1b-5ab03d215f46 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.243607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb449cb-9b49-4b52-9c1b-5ab03d215f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.307768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1cb449cb-9b49-4b52-9c1b-5ab03d215f46 None None] MFA Rules not processed for user `b8170812dd1b4c20bb07d3ac6a86d998`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:54:58.310128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1cb449cb-9b49-4b52-9c1b-5ab03d215f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:58.375340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 856/1712] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:58.411937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:58.459502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.461038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:54:58.495168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 857/1713] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:54:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:54:58.586359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef19c4-aa7d-4f59-ac7a-81ecdd4da60d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:58.615071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb449cb-9b49-4b52-9c1b-5ab03d215f46 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:54:58.753027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac63e69-5142-4ccf-9376-f7d2d9dd1e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:58.755891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac63e69-5142-4ccf-9376-f7d2d9dd1e82 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.755891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac63e69-5142-4ccf-9376-f7d2d9dd1e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.756200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac63e69-5142-4ccf-9376-f7d2d9dd1e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.805650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb449cb-9b49-4b52-9c1b-5ab03d215f46 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:54:58.825741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:54:58.827680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:54:58.828242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:54:58.829390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:54:58.860492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:58.873565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:58.921360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 858/1714] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:54:58.955663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac63e69-5142-4ccf-9376-f7d2d9dd1e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:54:58.959497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac63e69-5142-4ccf-9376-f7d2d9dd1e82 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:54:59.004736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 857/1715] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:54:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:00.354663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:00.354663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:00.488064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995c13d-9b24-4d3f-882d-3af9fc1ba818 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:00.494498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:00.496543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:00.497135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:00.497553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] PATH_INFO: `/v3/projects/a3d3582c1a2748a39bd203712bbb4f8a` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:00.499234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d3582c1a2748a39bd203712bbb4f8a)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:00.502416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:00.667291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d3582c1a2748a39bd203712bbb4f8a', 'request_id': 'req-88c29a87-0811-4608-bd40-22476da796fb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:00.750376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d3582c1a2748a39bd203712bbb4f8a', 'request_id': 'req-88c29a87-0811-4608-bd40-22476da796fb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:00.778149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d3582c1a2748a39bd203712bbb4f8a', 'request_id': 'req-88c29a87-0811-4608-bd40-22476da796fb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:00.804835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] The token cache is being invalidate because project a3d3582c1a2748a39bd203712bbb4f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:00.805397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:00.807157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88c29a87-0811-4608-bd40-22476da796fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:00.810599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 859/1716] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:00 2022] DELETE /identity/v3/projects/a3d3582c1a2748a39bd203712bbb4f8a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:00.815618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7b69-2b90-44ac-aa4c-a6ab3d3c01c3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:00.816120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7b69-2b90-44ac-aa4c-a6ab3d3c01c3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:00.816120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef7b69-2b90-44ac-aa4c-a6ab3d3c01c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:00.872010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-54ef7b69-2b90-44ac-aa4c-a6ab3d3c01c3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:00.872581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-54ef7b69-2b90-44ac-aa4c-a6ab3d3c01c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:00.889626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:01.019908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 858/1717] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:01.029854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac31517-a545-40a1-9a01-7f77bc4f119a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.031615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac31517-a545-40a1-9a01-7f77bc4f119a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.031894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac31517-a545-40a1-9a01-7f77bc4f119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.056187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:01.099086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9ac31517-a545-40a1-9a01-7f77bc4f119a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:01.101656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9ac31517-a545-40a1-9a01-7f77bc4f119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:01.115326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 860/1718] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:01.120165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7b69-2b90-44ac-aa4c-a6ab3d3c01c3 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.134908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef7b69-2b90-44ac-aa4c-a6ab3d3c01c3 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.146370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.147421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.147702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.147977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.148757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:01.149064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.150802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.178441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 859/1719] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:01.183127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac31517-a545-40a1-9a01-7f77bc4f119a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.195257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac31517-a545-40a1-9a01-7f77bc4f119a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.202436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.203709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.204734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.205333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.206372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.209241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.303325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 861/1720] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:01 2022] POST /identity/v3/projects => generated 407 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:01.309458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.323459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8460c-be71-49ba-8d15-9722a4c18d52 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.419409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.420059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.420363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.420955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.421365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.423355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.546025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 860/1721] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:01 2022] POST /identity/v3/users => generated 304 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:01.547768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.561515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78ab74-d2a7-48b5-9f3a-0a148f018509 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.566852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.567633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.568097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.569225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.569341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.571021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.592076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 862/1722] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:55:01.595999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.610189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbc513-4bd0-4144-abcd-d7e7516c9c54 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.615522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac00a95-7926-4770-b68b-8ab8919c8f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.616500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00a95-7926-4770-b68b-8ab8919c8f7c admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.616826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00a95-7926-4770-b68b-8ab8919c8f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.617176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac00a95-7926-4770-b68b-8ab8919c8f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.618487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac00a95-7926-4770-b68b-8ab8919c8f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.620597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac00a95-7926-4770-b68b-8ab8919c8f7c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.634711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 861/1723] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:01.642055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:01.656729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80d52-b48b-4cbe-a8c0-474246dbd04c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:01.676411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609d180-d045-45d7-8c2b-c46f8fe9e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:01.676411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d180-d045-45d7-8c2b-c46f8fe9e062 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.676411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d180-d045-45d7-8c2b-c46f8fe9e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.676411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d180-d045-45d7-8c2b-c46f8fe9e062 admin admin] PATH_INFO: `/v3/projects/d98ae4573c2149e19b9d90fd8ec5f44e/users/2602e130454145be888bcc7572ae3c2f/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.709327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609d180-d045-45d7-8c2b-c46f8fe9e062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98ae4573c2149e19b9d90fd8ec5f44e, user_id=2602e130454145be888bcc7572ae3c2f, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:01.712240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609d180-d045-45d7-8c2b-c46f8fe9e062 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:01.804560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 863/1724] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:01 2022] PUT /identity/v3/projects/d98ae4573c2149e19b9d90fd8ec5f44e/users/2602e130454145be888bcc7572ae3c2f/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:01.817037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e326f1-ea88-45f7-a6fa-8c3f4429cafd None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.817582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e326f1-ea88-45f7-a6fa-8c3f4429cafd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.817582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e326f1-ea88-45f7-a6fa-8c3f4429cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.874886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe2a0-3b47-414b-94ee-7d828d75a505 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:01.885647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe2a0-3b47-414b-94ee-7d828d75a505 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:01.885647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe2a0-3b47-414b-94ee-7d828d75a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:01.886179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e7e326f1-ea88-45f7-a6fa-8c3f4429cafd None None] MFA Rules not processed for user `2602e130454145be888bcc7572ae3c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:01.886179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e7e326f1-ea88-45f7-a6fa-8c3f4429cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:01.939507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1e3fe2a0-3b47-414b-94ee-7d828d75a505 None None] MFA Rules not processed for user `231abaa35f914e799ec1bb2b4f7e40a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:01.940682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1e3fe2a0-3b47-414b-94ee-7d828d75a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:02.007608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 862/1725] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:01 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:02.025125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e326f1-ea88-45f7-a6fa-8c3f4429cafd None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:02.046367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:02.116183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 864/1726] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:02.156702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e326f1-ea88-45f7-a6fa-8c3f4429cafd None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:02.167241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d210b6-6cca-44c4-adb0-e7097ccadc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:02.171032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d210b6-6cca-44c4-adb0-e7097ccadc5d admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.171032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d210b6-6cca-44c4-adb0-e7097ccadc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.171032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d210b6-6cca-44c4-adb0-e7097ccadc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.172235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e629a0-c6fd-4888-9b77-cf2e41399636 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.172670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e629a0-c6fd-4888-9b77-cf2e41399636 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.173107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e629a0-c6fd-4888-9b77-cf2e41399636 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.173228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d210b6-6cca-44c4-adb0-e7097ccadc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:02.175290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d210b6-6cca-44c4-adb0-e7097ccadc5d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:02.175671 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 865/1727] 10.222.0.49 () {54 vars in 960 bytes} [Fri Oct 28 09:55:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:02.184350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748c6a-430d-417f-85bc-ba02b7a9b63e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.185302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748c6a-430d-417f-85bc-ba02b7a9b63e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.193175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2748c6a-430d-417f-85bc-ba02b7a9b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.244252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f2748c6a-430d-417f-85bc-ba02b7a9b63e None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:02.246632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f2748c6a-430d-417f-85bc-ba02b7a9b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:02.301183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 863/1728] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:02 2022] POST /identity/v3/projects => generated 407 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:02.301183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8506-dfcb-4fd6-909a-732f3dd9118b None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.301183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8506-dfcb-4fd6-909a-732f3dd9118b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.301183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8506-dfcb-4fd6-909a-732f3dd9118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.365217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 866/1729] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 09:55:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:02.366989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2748c6a-430d-417f-85bc-ba02b7a9b63e None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:02.373706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cf0f8506-dfcb-4fd6-909a-732f3dd9118b None None] MFA Rules not processed for user `e1c7fbdb29a24a11b719fb59c8f57cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:02.375685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cf0f8506-dfcb-4fd6-909a-732f3dd9118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:02.379790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2748c6a-430d-417f-85bc-ba02b7a9b63e None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:02.398420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:02.476137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56cfe5-363c-4527-8377-84001a507bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:02.476682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cfe5-363c-4527-8377-84001a507bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.476956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cfe5-363c-4527-8377-84001a507bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.477303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cfe5-363c-4527-8377-84001a507bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.477860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56cfe5-363c-4527-8377-84001a507bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:02.479829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56cfe5-363c-4527-8377-84001a507bf6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:02.518741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 864/1730] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:02.519972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8506-dfcb-4fd6-909a-732f3dd9118b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:02.613193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 867/1731] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:02 2022] POST /identity/v3/users => generated 310 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:02.613193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e120d-e096-4298-81fe-5e121212bb10 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.613193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e120d-e096-4298-81fe-5e121212bb10 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.613193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e120d-e096-4298-81fe-5e121212bb10 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.614291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 868/1732] 10.222.0.49 () {54 vars in 960 bytes} [Fri Oct 28 09:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:02.617126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e120d-e096-4298-81fe-5e121212bb10 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:02.636003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e120d-e096-4298-81fe-5e121212bb10 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:02.660510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b6ded-4f50-4ce1-be03-9a7226f6ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:02.661690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b6ded-4f50-4ce1-be03-9a7226f6ba25 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.662299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b6ded-4f50-4ce1-be03-9a7226f6ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.663070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b6ded-4f50-4ce1-be03-9a7226f6ba25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.668911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b6ded-4f50-4ce1-be03-9a7226f6ba25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:02.670849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b6ded-4f50-4ce1-be03-9a7226f6ba25 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:02.705741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8506-dfcb-4fd6-909a-732f3dd9118b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:02.712543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 869/1733] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:02.715560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2164f61-8f72-45a3-baae-5bff9c7f4b59 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.716144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2164f61-8f72-45a3-baae-5bff9c7f4b59 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.716570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2164f61-8f72-45a3-baae-5bff9c7f4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.719424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:02.720323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.720712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.721122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.751646 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e2164f61-8f72-45a3-baae-5bff9c7f4b59 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:02.753509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e2164f61-8f72-45a3-baae-5bff9c7f4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:02.767736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 870/1734] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 09:55:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:02.779545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2164f61-8f72-45a3-baae-5bff9c7f4b59 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:02.805503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2164f61-8f72-45a3-baae-5bff9c7f4b59 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:02.821968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:02.823580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.824885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.828557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] PATH_INFO: `/v3/projects/88aa33fe97eb4199a9e140d6081272ac/users/e0abe72161df40d28ae55ca3d18f1adc/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.853464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88aa33fe97eb4199a9e140d6081272ac, user_id=e0abe72161df40d28ae55ca3d18f1adc, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:02.859799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:02.867312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:02.871868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:02.901524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 865/1735] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:02.903215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:02.922199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125dc5c4-51bc-4181-badb-793b19544d91 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:02.938351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:02.939896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:02.940826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:02.941042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 871/1736] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:02 2022] PUT /identity/v3/projects/88aa33fe97eb4199a9e140d6081272ac/users/e0abe72161df40d28ae55ca3d18f1adc/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:02.941320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:02.942241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:02.942698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:02.963862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:02.966232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:02.986197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 866/1737] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:03.102109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de824758-54c7-45f0-a8b1-774046e16846 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:03.119750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40e1a1-f1aa-4abe-a7ee-db81869ba27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:03.120397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e1a1-f1aa-4abe-a7ee-db81869ba27d admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:03.120710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e1a1-f1aa-4abe-a7ee-db81869ba27d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:03.120982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40e1a1-f1aa-4abe-a7ee-db81869ba27d admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:03.121632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40e1a1-f1aa-4abe-a7ee-db81869ba27d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:03.124237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40e1a1-f1aa-4abe-a7ee-db81869ba27d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:03.159409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 872/1738] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:03.159963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:03.181238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549a2a4-9159-4327-947d-5971fd91d048 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:03.199628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:03.200783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:03.201218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:03.201571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] PATH_INFO: `/v3/projects/88aa33fe97eb4199a9e140d6081272ac/users/e0abe72161df40d28ae55ca3d18f1adc/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:03.210643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88aa33fe97eb4199a9e140d6081272ac, user_id=e0abe72161df40d28ae55ca3d18f1adc, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:03.213552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:03.255483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 867/1739] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:03 2022] PUT /identity/v3/projects/88aa33fe97eb4199a9e140d6081272ac/users/e0abe72161df40d28ae55ca3d18f1adc/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:03.266752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf46017-240b-4ad5-8cb7-1b2dfddde081 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:03.267045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf46017-240b-4ad5-8cb7-1b2dfddde081 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:03.267318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf46017-240b-4ad5-8cb7-1b2dfddde081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:03.342444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-bdf46017-240b-4ad5-8cb7-1b2dfddde081 None None] MFA Rules not processed for user `e0abe72161df40d28ae55ca3d18f1adc`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:03.344545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-bdf46017-240b-4ad5-8cb7-1b2dfddde081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:03.483911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:03.551547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 873/1740] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:03 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:03.576771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:03.578703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:03.725664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a664-c413-4c8e-9ea2-4a9c9b2f5435 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:03.730612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:03.731379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:03.731908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:03.732544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:03.820716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b229b1-b91d-4036-909a-d66b76752f82 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:03.821257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b229b1-b91d-4036-909a-d66b76752f82 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:03.821367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b229b1-b91d-4036-909a-d66b76752f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:03.846493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:03.848950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:03.880379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 868/1741] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:03 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:03.893082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-98b229b1-b91d-4036-909a-d66b76752f82 None None] MFA Rules not processed for user `61905bcad03541acb0a06f57b1c55795`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:03.897824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-98b229b1-b91d-4036-909a-d66b76752f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:04.072200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 874/1742] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:04.087682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:04.215887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:04.263742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead850ea-40f0-439f-9f94-62b935be7c11 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:04.271579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:04.272703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:04.273125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:04.273612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:04.287234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:04.289481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:04.318264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 869/1743] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:05.134236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b229b1-b91d-4036-909a-d66b76752f82 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:05.171865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b229b1-b91d-4036-909a-d66b76752f82 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:05.188217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5afb6-5a84-4a00-aec2-b25c4a1e263b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:05.188762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5afb6-5a84-4a00-aec2-b25c4a1e263b service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:05.189168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5afb6-5a84-4a00-aec2-b25c4a1e263b service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:05.189450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5afb6-5a84-4a00-aec2-b25c4a1e263b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:05.211955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5afb6-5a84-4a00-aec2-b25c4a1e263b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:05.213618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5afb6-5a84-4a00-aec2-b25c4a1e263b service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:05.247111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 875/1744] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:05 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:05.957475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:05.958579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:06.100531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623a9d6-e525-4d0e-85df-b960b9d0eac8 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:06.114576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:06.130538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:06.130538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:06.130538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] PATH_INFO: `/v3/users/d714d879eea84852a748a5a44a777ec7` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:06.134543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d714d879eea84852a748a5a44a777ec7)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:06.144686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:06.426731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd714d879eea84852a748a5a44a777ec7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:06.612544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd714d879eea84852a748a5a44a777ec7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:06.656462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd714d879eea84852a748a5a44a777ec7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:06.657344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd714d879eea84852a748a5a44a777ec7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:06.675678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd714d879eea84852a748a5a44a777ec7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:06.695885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 870/1745] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:05 2022] DELETE /identity/v3/users/d714d879eea84852a748a5a44a777ec7 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:06.700332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:06.701361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:06.701824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:06.754623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:06.758922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:06.928006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 876/1746] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:06.971785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:06.973226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:07.214504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26959a-5a4e-4d1a-9335-d9a11bf896d4 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:07.234167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:07.234167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:07.234519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:07.234882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:07.248538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:07.257970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:07.260858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:07.296882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 871/1747] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:08.981858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:08.984383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:09.001098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b9f0d-dbe7-458f-9f9d-ab8d1d69bbca None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:09.012009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:09.040222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:09.043530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:09.044060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] PATH_INFO: `/v3/projects/6194e966f5634b5f990337e68ff12a0e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:09.058206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6194e966f5634b5f990337e68ff12a0e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:09.061269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:09.237683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6194e966f5634b5f990337e68ff12a0e', 'request_id': 'req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.244175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:09.330086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6194e966f5634b5f990337e68ff12a0e', 'request_id': 'req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.337672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6194e966f5634b5f990337e68ff12a0e', 'request_id': 'req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.363258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] The token cache is being invalidate because project 6194e966f5634b5f990337e68ff12a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:09.364034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.365143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-33d5507b-06ef-49e1-bdb5-2ed45f1cbe35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.375692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:09.376493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 877/1748] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:08 2022] DELETE /identity/v3/projects/6194e966f5634b5f990337e68ff12a0e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:09.397220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99cbcd-0be4-49f5-92af-83cf326e4b53 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:09.512969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:09.514930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:09.515422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:09.515928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] PATH_INFO: `/v3/users/0b52d2c152c34737a181dcf65a387def` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:09.517817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b52d2c152c34737a181dcf65a387def)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:09.522099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:09.712530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b52d2c152c34737a181dcf65a387def'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.810312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b52d2c152c34737a181dcf65a387def'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.837634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b52d2c152c34737a181dcf65a387def'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.839503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b52d2c152c34737a181dcf65a387def'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.864710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3462eb86-47f3-4ef1-8394-b9e3a7139bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b52d2c152c34737a181dcf65a387def'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:09.879039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 872/1749] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:09 2022] DELETE /identity/v3/users/0b52d2c152c34737a181dcf65a387def => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:10.267800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb241-f746-45ad-9a02-86659a7ff4c0 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:10.268224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb241-f746-45ad-9a02-86659a7ff4c0 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:10.268224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb241-f746-45ad-9a02-86659a7ff4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:10.314912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a22eb241-f746-45ad-9a02-86659a7ff4c0 None None] MFA Rules not processed for user `e1c7fbdb29a24a11b719fb59c8f57cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:10.316375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a22eb241-f746-45ad-9a02-86659a7ff4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:10.473842 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 878/1750] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:10.537095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cec4e-e067-47c5-adbf-d37d404494e9 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:10.537542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cec4e-e067-47c5-adbf-d37d404494e9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:10.537542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cec4e-e067-47c5-adbf-d37d404494e9 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:10.539221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 873/1751] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 09:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:10.547341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:10.547848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:10.548284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:10.575997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:10.577601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:10.665112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cec4e-e067-47c5-adbf-d37d404494e9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:10.667831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b74cec4e-e067-47c5-adbf-d37d404494e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:10.682141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 879/1752] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 09:55:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:10.694245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:10.695672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:10.779451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cec4e-e067-47c5-adbf-d37d404494e9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:10.788205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:10.789035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:10.789753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:10.790419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] PATH_INFO: `/v3/projects/eafddc094402409aa26f4d30d57ce49a` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:10.793353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafddc094402409aa26f4d30d57ce49a)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:10.796890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:10.819459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:10.847147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278869f2-9989-4882-80bf-e6469e27d6f6 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:10.851022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e782ae-6b8a-4d9a-979b-74b1904207e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:10.851636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e782ae-6b8a-4d9a-979b-74b1904207e3 service glance] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:10.851911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e782ae-6b8a-4d9a-979b-74b1904207e3 service glance] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:10.852181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e782ae-6b8a-4d9a-979b-74b1904207e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:10.867840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e782ae-6b8a-4d9a-979b-74b1904207e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:10.869406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e782ae-6b8a-4d9a-979b-74b1904207e3 service glance] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:10.875635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:10.886246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 880/1753] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:10.947208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568b95-a946-47ca-a57b-601ba4f83ae3 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:10.947979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568b95-a946-47ca-a57b-601ba4f83ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:10.948434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568b95-a946-47ca-a57b-601ba4f83ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:10.964422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafddc094402409aa26f4d30d57ce49a', 'request_id': 'req-814912d3-61ab-4e67-b4ff-02bd039aa821'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:10.975469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ad568b95-a946-47ca-a57b-601ba4f83ae3 None None] MFA Rules not processed for user `61905bcad03541acb0a06f57b1c55795`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:10.977986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ad568b95-a946-47ca-a57b-601ba4f83ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:11.055638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafddc094402409aa26f4d30d57ce49a', 'request_id': 'req-814912d3-61ab-4e67-b4ff-02bd039aa821'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:11.062092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafddc094402409aa26f4d30d57ce49a', 'request_id': 'req-814912d3-61ab-4e67-b4ff-02bd039aa821'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:11.081900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 881/1754] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:11.084338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] The token cache is being invalidate because project eafddc094402409aa26f4d30d57ce49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:11.084636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:11.086416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-814912d3-61ab-4e67-b4ff-02bd039aa821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:11.090557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 874/1755] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:10 2022] DELETE /identity/v3/projects/eafddc094402409aa26f4d30d57ce49a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:11.120446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ae40-f3dd-49c4-917f-5282170bab50 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.120571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ae40-f3dd-49c4-917f-5282170bab50 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.123015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ae40-f3dd-49c4-917f-5282170bab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.155924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9e11ae40-f3dd-49c4-917f-5282170bab50 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:11.158483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9e11ae40-f3dd-49c4-917f-5282170bab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:11.163412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131114-a651-47ea-a261-ef3ae977a5ae None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.163705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131114-a651-47ea-a261-ef3ae977a5ae None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.163981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5131114-a651-47ea-a261-ef3ae977a5ae None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.165778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 875/1756] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 09:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:11.170932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.171217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.182714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.210578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:11.213346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:11.283110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 882/1757] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:11.285800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971162-778b-420b-994c-a620d4bcf13c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.286203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971162-778b-420b-994c-a620d4bcf13c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.286603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47971162-778b-420b-994c-a620d4bcf13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.314306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 876/1758] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 09:55:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:11.325178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-47971162-778b-420b-994c-a620d4bcf13c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:11.326567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-47971162-778b-420b-994c-a620d4bcf13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:11.332762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.336570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:11.341260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 883/1759] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:11.342171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971162-778b-420b-994c-a620d4bcf13c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.353141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47971162-778b-420b-994c-a620d4bcf13c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.369338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.370150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.370503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.370765 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.371491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:11.371793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.377510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:11.411563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 884/1760] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:11.414971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.440634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aec60-19cb-42e2-94da-160696823947 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.451359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.453193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.454041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.454989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.456695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.462561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:11.472005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd95d44-28f9-4ead-8fb7-231e7fd640b1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.485013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.492746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.492746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.492746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.508989 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.511410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:11.525637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 877/1761] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:11.588720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 885/1762] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:11 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:11.592902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.607837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59c284-a8a5-4d95-baaa-2844398b5ffa service glance] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.695726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.697873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.698927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.699468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.700364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.703055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:11.730295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:11.786784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 878/1763] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:11 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:11.791456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.810634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca30fb-75b0-49b7-8f07-2ea7c3537ccf admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.818655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.821354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.821603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.821820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.822554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.825250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:11.840228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 886/1764] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:11.841456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.852553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940886-1fa2-47f0-a082-6f6a0e448e44 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.858353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412eda6-ce78-40c2-8aab-d61eb0161701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.859252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412eda6-ce78-40c2-8aab-d61eb0161701 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.859686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412eda6-ce78-40c2-8aab-d61eb0161701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.860249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412eda6-ce78-40c2-8aab-d61eb0161701 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.861366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412eda6-ce78-40c2-8aab-d61eb0161701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.863169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412eda6-ce78-40c2-8aab-d61eb0161701 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:11.875701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 879/1765] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:11.880579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:11.898314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70c5c9-6d40-497f-bdff-eb9bdd1d82c6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:11.906441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:11.907218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:11.907504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:11.907782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] PATH_INFO: `/v3/projects/2ac8c601319445fc94d96de4c443d6c0/users/4b951d4e3a8446bc8542b88c63c1d31e/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:11.935835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac8c601319445fc94d96de4c443d6c0, user_id=4b951d4e3a8446bc8542b88c63c1d31e, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:11.940572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:12.014742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 887/1766] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:11 2022] PUT /identity/v3/projects/2ac8c601319445fc94d96de4c443d6c0/users/4b951d4e3a8446bc8542b88c63c1d31e/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:12.028736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5fe7-685e-46f6-83d4-af8f2c6e0564 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.028736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5fe7-685e-46f6-83d4-af8f2c6e0564 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.028736 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5fe7-685e-46f6-83d4-af8f2c6e0564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.092774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-794a5fe7-685e-46f6-83d4-af8f2c6e0564 None None] MFA Rules not processed for user `4b951d4e3a8446bc8542b88c63c1d31e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:12.094889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-794a5fe7-685e-46f6-83d4-af8f2c6e0564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:12.191091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 880/1767] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:12.246829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:12.248622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:12.296140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:12.329277 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab7cf4-96ed-4a0b-9f6a-e1a9e9c73aed admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:12.341970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade3625-4cb5-421d-ad90-f3f2b68edcdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:12.341970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3625-4cb5-421d-ad90-f3f2b68edcdd service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.341970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3625-4cb5-421d-ad90-f3f2b68edcdd service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.341970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3625-4cb5-421d-ad90-f3f2b68edcdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.361793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3625-4cb5-421d-ad90-f3f2b68edcdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:12.363735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3625-4cb5-421d-ad90-f3f2b68edcdd service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:12.407507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 888/1768] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:12.434010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd94c9-9c37-4e32-882c-99f7ab0990a8 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.434663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd94c9-9c37-4e32-882c-99f7ab0990a8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.435138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd94c9-9c37-4e32-882c-99f7ab0990a8 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.438911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 881/1769] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 09:55:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:12.450388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94b343-bdc5-4b3a-9da3-dcfb6d41715f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.457046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94b343-bdc5-4b3a-9da3-dcfb6d41715f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.457046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94b343-bdc5-4b3a-9da3-dcfb6d41715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.509668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7b94b343-bdc5-4b3a-9da3-dcfb6d41715f None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:12.511223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7b94b343-bdc5-4b3a-9da3-dcfb6d41715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:12.520207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 889/1770] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 09:55:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:12.565349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd94c9-9c37-4e32-882c-99f7ab0990a8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:12.591537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.595848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.595848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.598997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd94c9-9c37-4e32-882c-99f7ab0990a8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:12.609100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22f71-3277-4314-8a10-7cecb43fe98a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:12.611577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22f71-3277-4314-8a10-7cecb43fe98a service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.612053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22f71-3277-4314-8a10-7cecb43fe98a service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.612539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22f71-3277-4314-8a10-7cecb43fe98a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.641109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22f71-3277-4314-8a10-7cecb43fe98a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:12.645671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22f71-3277-4314-8a10-7cecb43fe98a service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:12.664496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] MFA Rules not processed for user `231abaa35f914e799ec1bb2b4f7e40a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:12.668812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:12.693571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 882/1771] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:12.697004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734f53-6500-46e8-901f-11cfe83f7815 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.698412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734f53-6500-46e8-901f-11cfe83f7815 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.698865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734f53-6500-46e8-901f-11cfe83f7815 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.703527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 883/1772] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 09:55:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:12.712860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04508c5-e2c3-49ae-bab1-4b4b585dc59c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.713346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04508c5-e2c3-49ae-bab1-4b4b585dc59c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.713826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04508c5-e2c3-49ae-bab1-4b4b585dc59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.763597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f04508c5-e2c3-49ae-bab1-4b4b585dc59c None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:12.767453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f04508c5-e2c3-49ae-bab1-4b4b585dc59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:12.786514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 884/1773] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 09:55:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:12.811704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 890/1774] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:12.840932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04508c5-e2c3-49ae-bab1-4b4b585dc59c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:12.856302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04508c5-e2c3-49ae-bab1-4b4b585dc59c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:12.864926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:12.867048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:12.867511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:12.868028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:12.880212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:12.882930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:12.897702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 885/1775] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:13.820810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:13.822950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:14.001829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec5cef-d7cc-4f94-857a-e68691524e2a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:14.007529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:14.008401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:14.009512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:14.009879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:14.012586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:14.032609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:14.034621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:14.053915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 891/1776] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:14.058137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:14.061471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:14.093099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647b2fa-f509-4467-a3ee-77e06ff02c6c service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:14.100555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377b879-0c6b-4e2e-8672-05ec89e738c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:14.101437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b879-0c6b-4e2e-8672-05ec89e738c7 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:14.101863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b879-0c6b-4e2e-8672-05ec89e738c7 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:14.102285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b879-0c6b-4e2e-8672-05ec89e738c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:14.115103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377b879-0c6b-4e2e-8672-05ec89e738c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:14.117664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377b879-0c6b-4e2e-8672-05ec89e738c7 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:14.162740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 886/1777] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:15.495368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:15.497625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:15.595728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:15.622260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4110b-bf88-4c2b-973f-c3fff034f09c service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:15.629941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:15.631355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:15.631839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:15.632286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] PATH_INFO: `/v3/users/326a6b8a01684f5ebdf69fa0aa970f5a` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:15.634205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=326a6b8a01684f5ebdf69fa0aa970f5a)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:15.637340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:15.919848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326a6b8a01684f5ebdf69fa0aa970f5a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.028386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326a6b8a01684f5ebdf69fa0aa970f5a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.032650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326a6b8a01684f5ebdf69fa0aa970f5a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.048310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326a6b8a01684f5ebdf69fa0aa970f5a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.066053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326a6b8a01684f5ebdf69fa0aa970f5a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:16.074735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 892/1778] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:15 2022] DELETE /identity/v3/users/326a6b8a01684f5ebdf69fa0aa970f5a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:16.079102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:16.079659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:16.079887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:16.101231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:16.102859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:16.208247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:16.219678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 887/1779] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:16.232639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:16.239197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:16.362310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac7f87-2ec2-4438-90e1-246cbc0fc8ac admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:16.367472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:16.368197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:16.368702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:16.369419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:16.389455 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:16.393364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:16.404779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 893/1780] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:17.200396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.202382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:17.222568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdae89-2efc-4a53-87bb-db5a2119b2c2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.235361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.240468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.241474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.241894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] PATH_INFO: `/v3/projects/940322f9e16148968e14207f13b73ff1` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.245180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=940322f9e16148968e14207f13b73ff1)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.251195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.422022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '940322f9e16148968e14207f13b73ff1', 'request_id': 'req-c8203bd5-587c-4ea4-88bc-1267958340d7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.510490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '940322f9e16148968e14207f13b73ff1', 'request_id': 'req-c8203bd5-587c-4ea4-88bc-1267958340d7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.525475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '940322f9e16148968e14207f13b73ff1', 'request_id': 'req-c8203bd5-587c-4ea4-88bc-1267958340d7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.544524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] The token cache is being invalidate because project 940322f9e16148968e14207f13b73ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:17.544911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.546083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:17.549127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 888/1781] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:17 2022] DELETE /identity/v3/projects/940322f9e16148968e14207f13b73ff1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:17.553240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:17.568695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510369-648b-478a-9232-26711d6f9a9e service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:17.702387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:17.705946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:17.705946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:17.705946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] PATH_INFO: `/v3/users/5e8d133b1dc04323826880694c7061d8` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:17.705946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8d133b1dc04323826880694c7061d8)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:17.707961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:17.718604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:17.975645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8d133b1dc04323826880694c7061d8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:18.027736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8d133b1dc04323826880694c7061d8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:18.028932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8d133b1dc04323826880694c7061d8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:18.040967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8d133b1dc04323826880694c7061d8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:18.062187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5132a400-7a76-486c-b331-e7d24c336540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8d133b1dc04323826880694c7061d8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:18.070038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 894/1782] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:17 2022] DELETE /identity/v3/users/5e8d133b1dc04323826880694c7061d8 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:18.825131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:18.828551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:18.870335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8203bd5-587c-4ea4-88bc-1267958340d7 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:19.010727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:19.011543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.011831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.012104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] PATH_INFO: `/v3/projects/9d81785be95c4c9aa02fa1dd2700ba3b` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.013295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d81785be95c4c9aa02fa1dd2700ba3b)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:19.015386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:19.101611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da74d7-ce41-414d-a879-669164cd4b41 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.102229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da74d7-ce41-414d-a879-669164cd4b41 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.102332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da74d7-ce41-414d-a879-669164cd4b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.198637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d81785be95c4c9aa02fa1dd2700ba3b', 'request_id': 'req-79c666d0-fa44-4313-9d39-af6e38601784'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.209532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f4da74d7-ce41-414d-a879-669164cd4b41 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:19.211198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f4da74d7-ce41-414d-a879-669164cd4b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:19.283508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d81785be95c4c9aa02fa1dd2700ba3b', 'request_id': 'req-79c666d0-fa44-4313-9d39-af6e38601784'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.295061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d81785be95c4c9aa02fa1dd2700ba3b', 'request_id': 'req-79c666d0-fa44-4313-9d39-af6e38601784'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.309088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] The token cache is being invalidate because project 9d81785be95c4c9aa02fa1dd2700ba3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:19.309700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.310888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-79c666d0-fa44-4313-9d39-af6e38601784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:19.318476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 889/1783] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:18 2022] DELETE /identity/v3/projects/9d81785be95c4c9aa02fa1dd2700ba3b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:19.324717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b961bf-7e91-40e9-b289-ef7cfd7e508e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.325179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b961bf-7e91-40e9-b289-ef7cfd7e508e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.326209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b961bf-7e91-40e9-b289-ef7cfd7e508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.366013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 895/1784] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 09:55:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:19.416614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e1b961bf-7e91-40e9-b289-ef7cfd7e508e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:19.420455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e1b961bf-7e91-40e9-b289-ef7cfd7e508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:19.444441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:19.513562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 890/1785] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:19.522642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df01860-5a6d-428e-8206-2c51a52bf24d None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.522969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df01860-5a6d-428e-8206-2c51a52bf24d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.523246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df01860-5a6d-428e-8206-2c51a52bf24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.575497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7df01860-5a6d-428e-8206-2c51a52bf24d None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:19.578075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7df01860-5a6d-428e-8206-2c51a52bf24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:19.588145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 896/1786] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:19.593296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b961bf-7e91-40e9-b289-ef7cfd7e508e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:19.609895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b961bf-7e91-40e9-b289-ef7cfd7e508e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:19.618144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:19.620291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.620680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.620818 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.625035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:19.625389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:19.627102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:19.656274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 891/1787] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:55:19.660730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df01860-5a6d-428e-8206-2c51a52bf24d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:19.674471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df01860-5a6d-428e-8206-2c51a52bf24d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:19.680514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:19.681134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.681408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.681683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.683156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:19.685251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:19.810740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:19.812683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:19.818325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 897/1788] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:19 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:19.824697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:19.883915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:19.932899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fa15a-367f-4ab7-a280-112a46488668 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:19.943310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:19.943310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:19.943310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:19.943591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:19.944392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:19.946777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.012732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2862e6a-2c1d-41b1-aedb-33da9cd9b9c4 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.056309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 898/1789] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:19 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:20.056309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.079060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec9ea-f2bd-4d87-9b67-833a41af46c5 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.093043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.095344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.095344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.095344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.095344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.097810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.145798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 899/1790] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:55:20.153116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.159498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.160441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.161077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.161618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.182845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef85bc1-92c9-4995-a257-e446f8588631 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.193871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.194506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.194806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.195076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.199095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.202075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.234149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 900/1791] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:20.235453 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.254268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d4998-fcb0-4c4d-9a05-6e22a8e6eeff admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.270919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8e9d-0577-4c84-875e-966e9328917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.270919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8e9d-0577-4c84-875e-966e9328917f admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.270919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8e9d-0577-4c84-875e-966e9328917f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.270919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8e9d-0577-4c84-875e-966e9328917f admin admin] PATH_INFO: `/v3/projects/4abcfef514af4d9387bef4260eefcc77/users/a9983594df8c43f8b13de70a14d5daa9/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.290181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.294915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.322196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8e9d-0577-4c84-875e-966e9328917f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abcfef514af4d9387bef4260eefcc77, user_id=a9983594df8c43f8b13de70a14d5daa9, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.329360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 892/1792] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 09:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:20.329497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8e9d-0577-4c84-875e-966e9328917f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.377951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.380528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:20.449304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 901/1793] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:20 2022] PUT /identity/v3/projects/4abcfef514af4d9387bef4260eefcc77/users/a9983594df8c43f8b13de70a14d5daa9/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:20.459929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98fb2-57dc-4e7f-9e32-f0fe33cc7dc1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.460206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98fb2-57dc-4e7f-9e32-f0fe33cc7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.460473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a98fb2-57dc-4e7f-9e32-f0fe33cc7dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.534705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-57a98fb2-57dc-4e7f-9e32-f0fe33cc7dc1 None None] MFA Rules not processed for user `a9983594df8c43f8b13de70a14d5daa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:20.538724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-57a98fb2-57dc-4e7f-9e32-f0fe33cc7dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:20.590071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be84fd-03ef-4c0c-90a3-cd82681d7a02 service swift] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.605868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:20.733083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 902/1794] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:20.739440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a98fb2-57dc-4e7f-9e32-f0fe33cc7dc1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.768118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8170812dd1b4c20bb07d3ac6a86d998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fafff247268b48ddb6f898503ef047cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.771897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.772348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.773208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.776674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:20.777368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.783611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.828026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 893/1795] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:20.833993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:20.872947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48447f01-a8df-4d63-bc6a-46792be491a7 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:20.887225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8170812dd1b4c20bb07d3ac6a86d998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fafff247268b48ddb6f898503ef047cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:20.895542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:20.896254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:20.900325 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:20.905294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:20.912018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:20.992728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a98fb2-57dc-4e7f-9e32-f0fe33cc7dc1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:21.011958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:21.013816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.013816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.015523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.017710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:21.027711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:21.051795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:21.122421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 894/1796] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:20 2022] POST /identity/v3/projects => generated 348 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:21.128844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:21.160875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 903/1797] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:20 2022] POST /identity/v3/projects => generated 383 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:21.162495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:21.261211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:21.323467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57e06-1cd9-45cc-b3b5-09d9e0ad85f6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:21.329430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b999dde-9dfb-4caa-b470-3855d365e318 tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:21.338197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:21.339195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.339651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.341162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.342510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:21.344955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:21.503009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 904/1798] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:21 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:21.506647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:21.530215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c69af-271e-4d8a-a4ab-4695b8e3b4e2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:21.546591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:21.549881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.550898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.551126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.554061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:21.557786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:21.589579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8170812dd1b4c20bb07d3ac6a86d998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fafff247268b48ddb6f898503ef047cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:21.595786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.596250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.596531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.597301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:21.600771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:21.605839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:21.615256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 905/1799] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:55:21.616517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:21.647432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98ce3d-886d-41a1-8953-b9ecbe5feab2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:21.657987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee6ba-a7f8-4d95-a192-4f1c8e2c9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:21.659155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee6ba-a7f8-4d95-a192-4f1c8e2c9a3b admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.659525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee6ba-a7f8-4d95-a192-4f1c8e2c9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.667896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee6ba-a7f8-4d95-a192-4f1c8e2c9a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.667896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ee6ba-a7f8-4d95-a192-4f1c8e2c9a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:21.667896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ee6ba-a7f8-4d95-a192-4f1c8e2c9a3b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:21.668315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 895/1800] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:21.722663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 906/1801] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:21.725846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:21.742029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae7820-7434-41d3-bee8-104eb5b3cabb tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:21.757670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e0cac-9974-4eac-9b61-47ec2ae488eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:21.760664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0cac-9974-4eac-9b61-47ec2ae488eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:21.763196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0cac-9974-4eac-9b61-47ec2ae488eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:21.763845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0cac-9974-4eac-9b61-47ec2ae488eb admin admin] PATH_INFO: `/v3/projects/bb7fef52417e4518be00f16459b747dc/users/7a9a13707d1b40b585642d5835937775/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:21.816779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e0cac-9974-4eac-9b61-47ec2ae488eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7fef52417e4518be00f16459b747dc, user_id=7a9a13707d1b40b585642d5835937775, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:21.826213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e0cac-9974-4eac-9b61-47ec2ae488eb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.254793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 896/1802] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:21 2022] PUT /identity/v3/projects/bb7fef52417e4518be00f16459b747dc/users/7a9a13707d1b40b585642d5835937775/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:22.257437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc490-d104-4485-8097-9671d147333c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.258406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc490-d104-4485-8097-9671d147333c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.259724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fc490-d104-4485-8097-9671d147333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.338961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fc6fc490-d104-4485-8097-9671d147333c None None] MFA Rules not processed for user `7a9a13707d1b40b585642d5835937775`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:22.338961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fc6fc490-d104-4485-8097-9671d147333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:22.403361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.403774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.404249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.480735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:22.489006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:22.596141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 907/1803] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:22.600707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc490-d104-4485-8097-9671d147333c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.681395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 897/1804] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:22.713647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:22.750905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fc490-d104-4485-8097-9671d147333c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:22.757811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:22.758493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:22.758831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:22.759427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:22.760865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:22.764753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:22.848286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.850312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:22.882129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 908/1805] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/projects => generated 381 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:22.887153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:22.887889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59df0e-3913-4fca-aa54-f8cf7b52442f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.042794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.043495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.044859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.045141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.061802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4975ed-1601-445f-96a8-7abc86d4b385 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.080853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.084112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.085559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.086036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.086307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.086605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.087243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.089789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.105295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 898/1806] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:23.243122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 909/1807] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:22 2022] POST /identity/v3/users => generated 297 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:23.244182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.267431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755ba18-ff1d-42ce-b8fb-b7a7b2288d29 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.273036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.273667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.273953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.274234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.274921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.277221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.302711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 899/1808] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:23.305390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.333948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e24053-f130-40e5-be62-c928fc1d76e3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.352207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.353065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.353251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.353720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] PATH_INFO: `/v3/projects/a01fd5d5b7b0458a82b392c2d5b93196/users/c76bec16b719445d846f8669bf9e482c/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.411086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01fd5d5b7b0458a82b392c2d5b93196, user_id=c76bec16b719445d846f8669bf9e482c, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.414134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.574752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 910/1809] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:23 2022] PUT /identity/v3/projects/a01fd5d5b7b0458a82b392c2d5b93196/users/c76bec16b719445d846f8669bf9e482c/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:23.585409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.594574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:23.607756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc62527-a4c1-46c1-9093-7506ffa9cfbf admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.734929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b4b22-2de9-43af-97be-3e0ac92b1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.735708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4b22-2de9-43af-97be-3e0ac92b1bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.736096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4b22-2de9-43af-97be-3e0ac92b1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.736441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4b22-2de9-43af-97be-3e0ac92b1bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.737240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b4b22-2de9-43af-97be-3e0ac92b1bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.739539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b4b22-2de9-43af-97be-3e0ac92b1bd1 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.792306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 900/1810] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:23.794335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:23.815199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9663a-a7a4-443b-a75c-eab640706caf admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:23.831946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:23.833014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.833488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.838730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] PATH_INFO: `/v3/projects/a01fd5d5b7b0458a82b392c2d5b93196/users/c76bec16b719445d846f8669bf9e482c/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.846572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01fd5d5b7b0458a82b392c2d5b93196, user_id=c76bec16b719445d846f8669bf9e482c, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:23.849427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:23.871557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 911/1811] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:23 2022] PUT /identity/v3/projects/a01fd5d5b7b0458a82b392c2d5b93196/users/c76bec16b719445d846f8669bf9e482c/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:23.881460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8776e9-513b-4fed-9c67-e1ebbb9037b7 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:23.881982 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8776e9-513b-4fed-9c67-e1ebbb9037b7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:23.882398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8776e9-513b-4fed-9c67-e1ebbb9037b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:23.956468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-5a8776e9-513b-4fed-9c67-e1ebbb9037b7 None None] MFA Rules not processed for user `c76bec16b719445d846f8669bf9e482c`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:23.958267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5a8776e9-513b-4fed-9c67-e1ebbb9037b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:24.147819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 901/1812] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:24.175377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:24.330070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51feb-2e4d-4c6c-8840-144326b9d9ca admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:24.339355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:24.342372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:24.342372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:24.342372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:24.415499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:24.455769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8776e9-513b-4fed-9c67-e1ebbb9037b7 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:24.486754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:24.488844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:24.503263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 912/1813] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:24.600827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8776e9-513b-4fed-9c67-e1ebbb9037b7 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:24.607713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8170812dd1b4c20bb07d3ac6a86d998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fafff247268b48ddb6f898503ef047cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:24.608458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:24.608850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:24.609016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] PATH_INFO: `/v3/projects/9afb12cff066496e9f1e522f1536f964` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:24.610187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9afb12cff066496e9f1e522f1536f964)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:24.612417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:24.828220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:24.871349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afb12cff066496e9f1e522f1536f964', 'request_id': 'req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:24.974884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afb12cff066496e9f1e522f1536f964', 'request_id': 'req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:24.983996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afb12cff066496e9f1e522f1536f964', 'request_id': 'req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.032727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] The token cache is being invalidate because project 9afb12cff066496e9f1e522f1536f964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:25.036083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.040898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3d7b7740-8fc2-46a1-ab5e-27ebf9e6f55c tempest-RoutersIpV6AdminTest-1670330885 tempest-RoutersIpV6AdminTest-1670330885-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:25.053947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 902/1814] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:24 2022] DELETE /identity/v3/projects/9afb12cff066496e9f1e522f1536f964 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:55:25.081662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:25.096585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4038cee-4de0-4cb2-930b-c8883873cff5 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:25.163555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833dbd3-350f-49d5-9d84-f1d490f6a933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:25.164174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833dbd3-350f-49d5-9d84-f1d490f6a933 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:25.164457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833dbd3-350f-49d5-9d84-f1d490f6a933 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:25.164775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833dbd3-350f-49d5-9d84-f1d490f6a933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:25.167283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1833dbd3-350f-49d5-9d84-f1d490f6a933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:25.251953 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833dbd3-350f-49d5-9d84-f1d490f6a933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:25.258619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833dbd3-350f-49d5-9d84-f1d490f6a933 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:25.272256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 913/1815] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:27.062790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4268b7-fe1a-488d-bdc1-81ad9017372c None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.063719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4268b7-fe1a-488d-bdc1-81ad9017372c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.063994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4268b7-fe1a-488d-bdc1-81ad9017372c None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.065511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 903/1816] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:27.173601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.242228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.242228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.242228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:27.242228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:27.442869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 914/1817] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:55:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:27.649245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4268b7-fe1a-488d-bdc1-81ad9017372c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:27.673867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-aa4268b7-fe1a-488d-bdc1-81ad9017372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:27.696949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4268b7-fe1a-488d-bdc1-81ad9017372c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:27.706345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eaf37-54ea-4598-a58e-d95666eabcd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:27.709516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eaf37-54ea-4598-a58e-d95666eabcd8 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:27.709516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eaf37-54ea-4598-a58e-d95666eabcd8 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:27.709516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eaf37-54ea-4598-a58e-d95666eabcd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:27.721364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eaf37-54ea-4598-a58e-d95666eabcd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:27.723731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eaf37-54ea-4598-a58e-d95666eabcd8 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:27.760162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 904/1818] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:30.680608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:30.682831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:30.737902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:30.809013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b5d8f-2b2c-44a0-b8a1-adfb26c2d3e7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:30.823074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:30.824222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:30.824450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:30.824921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] PATH_INFO: `/v3/users/2602e130454145be888bcc7572ae3c2f` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:30.826380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2602e130454145be888bcc7572ae3c2f)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:30.829347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.050706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2602e130454145be888bcc7572ae3c2f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:31.124567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2602e130454145be888bcc7572ae3c2f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:31.125393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2602e130454145be888bcc7572ae3c2f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:31.136259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2602e130454145be888bcc7572ae3c2f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:31.179196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2602e130454145be888bcc7572ae3c2f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:31.199927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 915/1819] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:30 2022] DELETE /identity/v3/users/2602e130454145be888bcc7572ae3c2f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:31.204501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.205155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.205155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.252697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:31.254214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:31.406129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 905/1820] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:31.417874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:31.419463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:31.550522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ec8c0-d56c-450f-93b4-664af3646ed4 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:31.550522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:31.550522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:31.550522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:31.550955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:31.550955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:31.550955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:31.550955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 916/1821] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:32.491312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:32.492940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:32.507588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd7bb8-3710-44fd-bcae-03b870afda92 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:32.515566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:32.515566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:32.515566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:32.536080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] PATH_INFO: `/v3/projects/d98ae4573c2149e19b9d90fd8ec5f44e` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:32.541181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98ae4573c2149e19b9d90fd8ec5f44e)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:32.541181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:32.760461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98ae4573c2149e19b9d90fd8ec5f44e', 'request_id': 'req-c275d6e7-6e6c-43f0-a084-26f27316ded5'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.834428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98ae4573c2149e19b9d90fd8ec5f44e', 'request_id': 'req-c275d6e7-6e6c-43f0-a084-26f27316ded5'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.843843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98ae4573c2149e19b9d90fd8ec5f44e', 'request_id': 'req-c275d6e7-6e6c-43f0-a084-26f27316ded5'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.886188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] The token cache is being invalidate because project d98ae4573c2149e19b9d90fd8ec5f44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:32.889268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.890574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:32.897035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 906/1822] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:32 2022] DELETE /identity/v3/projects/d98ae4573c2149e19b9d90fd8ec5f44e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:32.901169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:32.919761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258efdc-3f8b-4991-a366-805d8175c4d6 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:33.049509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:33.092494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:33.099869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:33.099869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:33.099869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] PATH_INFO: `/v3/users/e0abe72161df40d28ae55ca3d18f1adc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:33.099869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0abe72161df40d28ae55ca3d18f1adc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:33.099869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:33.391448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0abe72161df40d28ae55ca3d18f1adc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.449863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0abe72161df40d28ae55ca3d18f1adc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.451001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0abe72161df40d28ae55ca3d18f1adc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.461365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0abe72161df40d28ae55ca3d18f1adc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.495535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7bb44fef-7f37-4e1a-9114-67314f7ac098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0abe72161df40d28ae55ca3d18f1adc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:33.514347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 917/1823] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:32 2022] DELETE /identity/v3/users/e0abe72161df40d28ae55ca3d18f1adc => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:35.018034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.019528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:35.033165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d6e7-6e6c-43f0-a084-26f27316ded5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.080053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:35.150802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.151733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.151733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.152025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] PATH_INFO: `/v3/projects/88aa33fe97eb4199a9e140d6081272ac` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.153186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88aa33fe97eb4199a9e140d6081272ac)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.155381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.315497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88aa33fe97eb4199a9e140d6081272ac', 'request_id': 'req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:35.381292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88aa33fe97eb4199a9e140d6081272ac', 'request_id': 'req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:35.389400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88aa33fe97eb4199a9e140d6081272ac', 'request_id': 'req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:35.410913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] The token cache is being invalidate because project 88aa33fe97eb4199a9e140d6081272ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:35.411612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:35.412817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-83cc6e7c-ed2f-445e-98a9-41c78531c0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:35.416089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 907/1824] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:35 2022] DELETE /identity/v3/projects/88aa33fe97eb4199a9e140d6081272ac => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:35.420873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf070220-287b-4f1d-b166-abbcd21256fc None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.424569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf070220-287b-4f1d-b166-abbcd21256fc None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.424569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf070220-287b-4f1d-b166-abbcd21256fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.487702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cf070220-287b-4f1d-b166-abbcd21256fc None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:35.493261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cf070220-287b-4f1d-b166-abbcd21256fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:35.667484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 918/1825] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:35.674784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec74f-2f0c-4db2-b708-cc7407ca80c2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.675073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec74f-2f0c-4db2-b708-cc7407ca80c2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.675347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ec74f-2f0c-4db2-b708-cc7407ca80c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.712320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-088ec74f-2f0c-4db2-b708-cc7407ca80c2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:35.713390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-088ec74f-2f0c-4db2-b708-cc7407ca80c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:35.726561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 908/1826] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:35.731040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf070220-287b-4f1d-b166-abbcd21256fc None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.748540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf070220-287b-4f1d-b166-abbcd21256fc None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.756420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.761450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.761450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.761450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.761872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:35.762390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.765423 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.787722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 919/1827] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:35.793491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec74f-2f0c-4db2-b708-cc7407ca80c2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.804358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ec74f-2f0c-4db2-b708-cc7407ca80c2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:35.809738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:35.810360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:35.811681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:35.811681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:35.812353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:35.815202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:35.915998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 909/1828] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:55:35.921056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:35.937660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b8895-7e68-43af-9855-82e110c641e3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.012754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:36.024311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.026271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.033150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.033150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.033150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.033150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.136760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 920/1829] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:35 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:36.136848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.159120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4baf6f-8e8c-45ab-83b3-0d95910e67e3 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.167666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.169053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.169708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.170131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.171037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.173528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.196093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 910/1830] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:36.201485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.220105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33954b58-2706-4498-a9f6-3f7a6e3161da admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.227706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e2a40-5429-4774-be0c-3aaed7657e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.228522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2a40-5429-4774-be0c-3aaed7657e30 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.229013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2a40-5429-4774-be0c-3aaed7657e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.229383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e2a40-5429-4774-be0c-3aaed7657e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.230374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e2a40-5429-4774-be0c-3aaed7657e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.232166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e2a40-5429-4774-be0c-3aaed7657e30 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.262991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 921/1831] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:36.266415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.287201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43f4fd-2be8-457d-8381-e0df7ef35a35 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.300001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.300980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.302349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.302970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] PATH_INFO: `/v3/projects/c4ec231d8ef7459795533d5eb1a2f8df/users/c59285d610794de59af7a51e22e16c77/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.338292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ec231d8ef7459795533d5eb1a2f8df, user_id=c59285d610794de59af7a51e22e16c77, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.341845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.491263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 911/1832] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:36 2022] PUT /identity/v3/projects/c4ec231d8ef7459795533d5eb1a2f8df/users/c59285d610794de59af7a51e22e16c77/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:36.502588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63445-1e78-4ee8-819e-1ee6b8ee37af None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.503299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63445-1e78-4ee8-819e-1ee6b8ee37af None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.503299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef63445-1e78-4ee8-819e-1ee6b8ee37af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.551624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0ef63445-1e78-4ee8-819e-1ee6b8ee37af None None] MFA Rules not processed for user `c59285d610794de59af7a51e22e16c77`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:36.553270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0ef63445-1e78-4ee8-819e-1ee6b8ee37af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:36.669760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 922/1833] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:36.684491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:36.690527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:36.775602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4fdbb3-8500-40a4-918d-32fa7ef6bacd admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:36.780132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec707ed5-8938-42a4-9c53-0d031f87e71c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:36.781275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec707ed5-8938-42a4-9c53-0d031f87e71c service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:36.781476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec707ed5-8938-42a4-9c53-0d031f87e71c service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:36.781711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec707ed5-8938-42a4-9c53-0d031f87e71c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:36.788517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:36.794367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec707ed5-8938-42a4-9c53-0d031f87e71c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:36.796199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec707ed5-8938-42a4-9c53-0d031f87e71c service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:36.809387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 912/1834] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:43.483368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551879d-7523-435d-bc02-5e8364f7eaf1 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:43.485462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551879d-7523-435d-bc02-5e8364f7eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:43.486222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551879d-7523-435d-bc02-5e8364f7eaf1 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:43.491087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 923/1835] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:55:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:43.530123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3df3-93bd-477d-9686-6f7d435d0672 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:43.531820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3df3-93bd-477d-9686-6f7d435d0672 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:43.532573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3df3-93bd-477d-9686-6f7d435d0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:43.643642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-df8c3df3-93bd-477d-9686-6f7d435d0672 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:43.649418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-df8c3df3-93bd-477d-9686-6f7d435d0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:43.859744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 913/1836] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:55:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:43.887482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551879d-7523-435d-bc02-5e8364f7eaf1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:43.890966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d551879d-7523-435d-bc02-5e8364f7eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:43.936088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551879d-7523-435d-bc02-5e8364f7eaf1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:43.948072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe866a-a09a-46bf-a638-7f1c60a7c020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:43.950159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe866a-a09a-46bf-a638-7f1c60a7c020 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:43.950159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe866a-a09a-46bf-a638-7f1c60a7c020 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:43.950581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe866a-a09a-46bf-a638-7f1c60a7c020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:43.970134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe866a-a09a-46bf-a638-7f1c60a7c020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:43.973240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe866a-a09a-46bf-a638-7f1c60a7c020 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:44.019913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 924/1837] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:50.616686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3df3-93bd-477d-9686-6f7d435d0672 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:50.771796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3df3-93bd-477d-9686-6f7d435d0672 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:50.783349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:50.784709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:50.785044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:50.785318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] PATH_INFO: `/v3/users/c59285d610794de59af7a51e22e16c77` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:50.787634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59285d610794de59af7a51e22e16c77)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:50.790862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:51.012147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59285d610794de59af7a51e22e16c77'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:51.128153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59285d610794de59af7a51e22e16c77'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:51.155018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59285d610794de59af7a51e22e16c77'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:51.156846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59285d610794de59af7a51e22e16c77'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:51.172462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59285d610794de59af7a51e22e16c77'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:51.184953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 914/1838] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:55:50 2022] DELETE /identity/v3/users/c59285d610794de59af7a51e22e16c77 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:51.186194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b984cd-be5c-4898-a142-2c9f69bf2fad None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:51.187260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b984cd-be5c-4898-a142-2c9f69bf2fad None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:51.187703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b984cd-be5c-4898-a142-2c9f69bf2fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:51.220505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-32b984cd-be5c-4898-a142-2c9f69bf2fad None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:51.221760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-32b984cd-be5c-4898-a142-2c9f69bf2fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:51.308845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 925/1839] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:55:51.389631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:51.392808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:51.418304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:51.520827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772cd3a-070b-4a15-9e0b-395ba8921c93 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:51.528437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107cc05e-4347-4a77-939e-37a11e5ea503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:51.529229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cc05e-4347-4a77-939e-37a11e5ea503 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:51.529571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cc05e-4347-4a77-939e-37a11e5ea503 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:51.530266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cc05e-4347-4a77-939e-37a11e5ea503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:51.556586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cc05e-4347-4a77-939e-37a11e5ea503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:51.558939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107cc05e-4347-4a77-939e-37a11e5ea503 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:51.574954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 915/1840] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:53.672038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e6af4-b28b-487a-a83c-91f28acfebd8 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:53.673271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e6af4-b28b-487a-a83c-91f28acfebd8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:53.673715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e6af4-b28b-487a-a83c-91f28acfebd8 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:53.676305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 926/1841] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 09:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 09:55:53.709584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:53.710173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:53.710173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:53.737007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:53.750592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:53.810927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e6af4-b28b-487a-a83c-91f28acfebd8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:53.814518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-860e6af4-b28b-487a-a83c-91f28acfebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:53.847535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e6af4-b28b-487a-a83c-91f28acfebd8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:53.863861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:53.864776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:53.865210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:53.865629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] PATH_INFO: `/v3/projects/c4ec231d8ef7459795533d5eb1a2f8df` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:53.867121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ec231d8ef7459795533d5eb1a2f8df)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:53.873880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:53.982248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 916/1842] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 09:55:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:54.014361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:54.022466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ec231d8ef7459795533d5eb1a2f8df', 'request_id': 'req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:54.041085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:54.042552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:54.061796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a765c1-d097-4075-a4ef-5120ea315931 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:54.153376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ec231d8ef7459795533d5eb1a2f8df', 'request_id': 'req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:54.167349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ec231d8ef7459795533d5eb1a2f8df', 'request_id': 'req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:54.187589 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:54.190825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.191113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.191383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.194415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] The token cache is being invalidate because project c4ec231d8ef7459795533d5eb1a2f8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:55:54.194415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:54.195684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e3a3dd51-7e53-4a5d-8c5d-753f2a724e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:55:54.200239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 927/1843] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:53 2022] DELETE /identity/v3/projects/c4ec231d8ef7459795533d5eb1a2f8df => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:54.210615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73243f50-2676-427a-92bc-cf45c7aea305 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.211322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73243f50-2676-427a-92bc-cf45c7aea305 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.212049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73243f50-2676-427a-92bc-cf45c7aea305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.223918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:54.234191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:54.270805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 917/1844] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:54.275614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-73243f50-2676-427a-92bc-cf45c7aea305 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:54.277112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-73243f50-2676-427a-92bc-cf45c7aea305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:54.327442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:54.329410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:54.401430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:54.445243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 928/1845] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:54.454364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e04849-49cc-4610-b79b-a30ba9656c79 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:54.456414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b5d0-cb5b-4565-94f9-a0b503336543 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.456414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b5d0-cb5b-4565-94f9-a0b503336543 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.456414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465b5d0-cb5b-4565-94f9-a0b503336543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.468031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:54.469326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.470027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.470627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.475813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:54.512095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c465b5d0-cb5b-4565-94f9-a0b503336543 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:54.514657 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c465b5d0-cb5b-4565-94f9-a0b503336543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:54.533790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 929/1846] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:54.538258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465b5d0-cb5b-4565-94f9-a0b503336543 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:54.557974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465b5d0-cb5b-4565-94f9-a0b503336543 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:54.564007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:54.564631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.564908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.565180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.566040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:55:54.566339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:54.568178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:54.585954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 930/1847] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:55:54.587638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:54.588818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:54.589186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:54.601332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4ec01-aad8-4745-8811-45c765031726 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:54.603024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 918/1848] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:55:54.608862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:54.609699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.610048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.610397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.611944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:54.636826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:54.768787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 931/1849] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:55:54 2022] POST /identity/v3/projects => generated 357 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:54.770295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:54.794269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cec051-63d8-4489-9dae-6fee8a5414a7 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:54.952952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:54.954276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:54.954807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:54.955287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:54.956913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:54.959592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:55.106279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 919/1850] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:55:54 2022] POST /identity/v3/users => generated 279 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:55:55.110736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:55.151680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d0dd7-ed33-440b-bf87-360b8834f5d9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:55.164364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:55.165183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:55.165754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:55.166925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:55.167731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:55.173403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:55.192712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 932/1851] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:55.197400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:55.215778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ede8f-fc5b-4075-bf64-72dfa91b01b3 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:55.223697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91c11c-4752-405b-ba78-199d8b4eb3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:55.225888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c11c-4752-405b-ba78-199d8b4eb3cb admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:55.226248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c11c-4752-405b-ba78-199d8b4eb3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:55.226866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91c11c-4752-405b-ba78-199d8b4eb3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:55.228198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91c11c-4752-405b-ba78-199d8b4eb3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:55.231083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91c11c-4752-405b-ba78-199d8b4eb3cb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:55.250278 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 920/1852] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:55:55.251971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:55.272209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c846a4-3468-4ec2-bb3c-e62731988597 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:55.279264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:55.279998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:55.280282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:55.280567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] PATH_INFO: `/v3/projects/89cfc5b3f25c4c4690ddbdba676c129f/users/aa495841913747d098c6a0f8628bd757/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:55.309588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cfc5b3f25c4c4690ddbdba676c129f, user_id=aa495841913747d098c6a0f8628bd757, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:55.316922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:55.416316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 933/1853] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:55:55 2022] PUT /identity/v3/projects/89cfc5b3f25c4c4690ddbdba676c129f/users/aa495841913747d098c6a0f8628bd757/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:55:55.426979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804561f-61b7-4cd1-a174-ed993c61de54 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:55.429798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804561f-61b7-4cd1-a174-ed993c61de54 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:55.431552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804561f-61b7-4cd1-a174-ed993c61de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:55.519836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4804561f-61b7-4cd1-a174-ed993c61de54 None None] MFA Rules not processed for user `aa495841913747d098c6a0f8628bd757`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:55:55.524885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4804561f-61b7-4cd1-a174-ed993c61de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:55.641144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:55.690133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 921/1854] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:55:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:55:55.708288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:55:55.710498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:55:55.793686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0a68f-9638-44fc-a0bf-cbe167b6f48a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:55:55.807365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:55:55.808364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:55:55.808788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:55:55.809187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:55:55.821155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:55.828660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:55:55.831204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:55:55.845919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 934/1855] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:55:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:56:05.801894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=8 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:06.025820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:07.818768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804561f-61b7-4cd1-a174-ed993c61de54 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:07.841478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804561f-61b7-4cd1-a174-ed993c61de54 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:07.873750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22835b-e34e-4aeb-88ab-061da04959a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:07.873750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22835b-e34e-4aeb-88ab-061da04959a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:07.873750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22835b-e34e-4aeb-88ab-061da04959a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:07.874887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22835b-e34e-4aeb-88ab-061da04959a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:07.881479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fe22835b-e34e-4aeb-88ab-061da04959a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:08.031355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22835b-e34e-4aeb-88ab-061da04959a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:08.033554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22835b-e34e-4aeb-88ab-061da04959a2 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:08.046181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 922/1856] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:18.039482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=28 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:26.479304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:26.481328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:26.618154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755e973-939c-4e08-99e1-ace7b64121c9 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:26.624353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:26.625456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:26.625795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:26.626075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] PATH_INFO: `/v3/users/a9983594df8c43f8b13de70a14d5daa9` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:26.627530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9983594df8c43f8b13de70a14d5daa9)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:26.630469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:26.912472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9983594df8c43f8b13de70a14d5daa9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.000754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9983594df8c43f8b13de70a14d5daa9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.001956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9983594df8c43f8b13de70a14d5daa9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.024785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9983594df8c43f8b13de70a14d5daa9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.048036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9983594df8c43f8b13de70a14d5daa9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:27.065664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 935/1857] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:26 2022] DELETE /identity/v3/users/a9983594df8c43f8b13de70a14d5daa9 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:27.065879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:27.066306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:27.066408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:27.094741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:27.097049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:27.191956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 923/1858] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:27.247963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:27.249618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:27.353627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e6e95-5474-421e-84dd-abc76b6f9f2d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:27.371127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:27.371786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:27.372064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:27.372493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:27.397001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:27.398805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:27.417410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 936/1859] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:28.544182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:28.545730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:28.571757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fb5ce-b96b-472e-a71a-9be212e4ce01 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:28.577699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:28.578634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.579144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.579588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] PATH_INFO: `/v3/projects/4abcfef514af4d9387bef4260eefcc77` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.580832 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abcfef514af4d9387bef4260eefcc77)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:28.583611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:28.723753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abcfef514af4d9387bef4260eefcc77', 'request_id': 'req-0389235a-2d43-4298-a2b2-244148589121'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.801119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abcfef514af4d9387bef4260eefcc77', 'request_id': 'req-0389235a-2d43-4298-a2b2-244148589121'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.809055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abcfef514af4d9387bef4260eefcc77', 'request_id': 'req-0389235a-2d43-4298-a2b2-244148589121'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.833041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] The token cache is being invalidate because project 4abcfef514af4d9387bef4260eefcc77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:28.833041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.833041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:28.840776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 924/1860] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:28 2022] DELETE /identity/v3/projects/4abcfef514af4d9387bef4260eefcc77 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:28.844971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:28.859903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e8132-f29b-4602-9388-c717f4f98348 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:28.893893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:28.981310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:28.981310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:28.981310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:28.981310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] PATH_INFO: `/v3/users/7a9a13707d1b40b585642d5835937775` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:28.981971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9a13707d1b40b585642d5835937775)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:28.983589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:29.216654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9a13707d1b40b585642d5835937775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.281382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9a13707d1b40b585642d5835937775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.282074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9a13707d1b40b585642d5835937775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.298150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9a13707d1b40b585642d5835937775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.334755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9a13707d1b40b585642d5835937775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:29.350499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 937/1861] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:28 2022] DELETE /identity/v3/users/7a9a13707d1b40b585642d5835937775 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:56:31.282754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:31.292131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:31.315900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389235a-2d43-4298-a2b2-244148589121 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:31.504239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:31.504909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:31.505187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:31.505526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] PATH_INFO: `/v3/projects/bb7fef52417e4518be00f16459b747dc` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:31.508356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7fef52417e4518be00f16459b747dc)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:31.510358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:31.699090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:31.762304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7fef52417e4518be00f16459b747dc', 'request_id': 'req-1c81ae8d-94a4-48da-a436-5e59d23be201'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.868888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7fef52417e4518be00f16459b747dc', 'request_id': 'req-1c81ae8d-94a4-48da-a436-5e59d23be201'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.887792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7fef52417e4518be00f16459b747dc', 'request_id': 'req-1c81ae8d-94a4-48da-a436-5e59d23be201'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.909175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] The token cache is being invalidate because project bb7fef52417e4518be00f16459b747dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:31.909471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.910960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:31.916742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 925/1862] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:31 2022] DELETE /identity/v3/projects/bb7fef52417e4518be00f16459b747dc => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:31.917596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:31.919133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:31.936279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339840c-1778-4cb2-aa60-f7e892425bda admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:32.062410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:32.063095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:32.063521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:32.063800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] PATH_INFO: `/v3/users/c76bec16b719445d846f8669bf9e482c` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:32.065024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76bec16b719445d846f8669bf9e482c)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:32.067283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:32.307859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:32.317210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76bec16b719445d846f8669bf9e482c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:32.452587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76bec16b719445d846f8669bf9e482c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:32.453705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76bec16b719445d846f8669bf9e482c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:32.468821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76bec16b719445d846f8669bf9e482c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:32.494374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-aca03d45-e85e-44c4-b73c-ac89cc2e4369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76bec16b719445d846f8669bf9e482c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:32.510787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 938/1863] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:31 2022] DELETE /identity/v3/users/c76bec16b719445d846f8669bf9e482c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:34.606165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:34.611254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:34.628541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81ae8d-94a4-48da-a436-5e59d23be201 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:34.806928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:34.808067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:34.808184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:34.808441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] PATH_INFO: `/v3/projects/a01fd5d5b7b0458a82b392c2d5b93196` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:34.809631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01fd5d5b7b0458a82b392c2d5b93196)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:34.811700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:34.976963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01fd5d5b7b0458a82b392c2d5b93196', 'request_id': 'req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:35.040728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01fd5d5b7b0458a82b392c2d5b93196', 'request_id': 'req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:35.053032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01fd5d5b7b0458a82b392c2d5b93196', 'request_id': 'req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:35.099656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] The token cache is being invalidate because project a01fd5d5b7b0458a82b392c2d5b93196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:35.099656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:35.105991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ae8bd60-98fd-470a-b4e6-79e2287d6b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:35.108210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 926/1864] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:34 2022] DELETE /identity/v3/projects/a01fd5d5b7b0458a82b392c2d5b93196 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:35.114233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d19b-73f0-4b2d-bf34-d33561c3726a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:35.114854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d19b-73f0-4b2d-bf34-d33561c3726a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:35.114966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2d19b-73f0-4b2d-bf34-d33561c3726a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:35.171517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7ee2d19b-73f0-4b2d-bf34-d33561c3726a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:35.173058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7ee2d19b-73f0-4b2d-bf34-d33561c3726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:35.265716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 939/1865] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:35.275376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe626fd-204f-4bee-89d1-7e28f99db072 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:35.275824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe626fd-204f-4bee-89d1-7e28f99db072 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:35.276169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe626fd-204f-4bee-89d1-7e28f99db072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:35.303306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-bfe626fd-204f-4bee-89d1-7e28f99db072 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:35.305038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bfe626fd-204f-4bee-89d1-7e28f99db072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:35.320390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d19b-73f0-4b2d-bf34-d33561c3726a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:35.330696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 927/1866] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:35.338058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2d19b-73f0-4b2d-bf34-d33561c3726a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:35.343747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:35.344538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:35.344911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:35.345434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:35.346360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:56:35.347381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:35.350793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:35.372930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe626fd-204f-4bee-89d1-7e28f99db072 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:35.381439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 940/1867] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:56:35.384215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe626fd-204f-4bee-89d1-7e28f99db072 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:35.390266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:35.391022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:35.391363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:35.391698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:35.392901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:35.394533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:35.489795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:35.493758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 928/1868] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:35 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:35.502831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32178502-3a99-4af0-9279-3873e5c5cbc9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:35.693910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:35.694616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:35.694915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:35.695197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:35.695896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:35.698048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:35.832937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 941/1869] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:35 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:35.835403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:35.858546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eddcc9-1daa-45bd-ab61-a10a60e4b39f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:35.871664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:35.872668 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:35.873090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:35.873645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:35.874758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:35.876749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:35.900003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:35.908544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 929/1870] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:35.915738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bb1c4-f466-41aa-a32a-45fbb270de76 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:35.937052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089207e6-7655-46a7-97e4-5775e96e9daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:35.937769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089207e6-7655-46a7-97e4-5775e96e9daf admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:35.942853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089207e6-7655-46a7-97e4-5775e96e9daf admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:35.943805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089207e6-7655-46a7-97e4-5775e96e9daf admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:35.944625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089207e6-7655-46a7-97e4-5775e96e9daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:35.947827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089207e6-7655-46a7-97e4-5775e96e9daf admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:35.975969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 942/1871] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:56:35.977867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:35.993195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:36.003161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba3d22-6055-41e7-b55e-b2dc2bc37445 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:36.015359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:36.016106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:36.016384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:36.016654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] PATH_INFO: `/v3/projects/098cc98cb06a49e9902b2cd6b9d5c4c5/users/24617d5be0d74280bc8b64496559e8cd/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:36.041895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=098cc98cb06a49e9902b2cd6b9d5c4c5, user_id=24617d5be0d74280bc8b64496559e8cd, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:36.044961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:36.199200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 930/1872] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:35 2022] PUT /identity/v3/projects/098cc98cb06a49e9902b2cd6b9d5c4c5/users/24617d5be0d74280bc8b64496559e8cd/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:36.203014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd35e-ee9c-4c23-b89f-181005d146a3 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:36.203567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd35e-ee9c-4c23-b89f-181005d146a3 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:36.203707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cd35e-ee9c-4c23-b89f-181005d146a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:36.260230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-870cd35e-ee9c-4c23-b89f-181005d146a3 None None] MFA Rules not processed for user `24617d5be0d74280bc8b64496559e8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:36.261617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-870cd35e-ee9c-4c23-b89f-181005d146a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:36.293115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:36.485605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 943/1873] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:36.532579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:36.534322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:36.733637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fed67-c14f-44b5-b0f0-5eeb5dabd7ec admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:36.740236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe11637-9c78-4b6c-8da8-d68014edd5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:36.742132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe11637-9c78-4b6c-8da8-d68014edd5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:36.742609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe11637-9c78-4b6c-8da8-d68014edd5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:36.744690 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe11637-9c78-4b6c-8da8-d68014edd5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:36.766040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe11637-9c78-4b6c-8da8-d68014edd5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:36.769019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe11637-9c78-4b6c-8da8-d68014edd5d0 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:36.785642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 931/1874] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:36.840033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cd35e-ee9c-4c23-b89f-181005d146a3 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:36.941965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cd35e-ee9c-4c23-b89f-181005d146a3 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:36.948019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:36.949068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:36.949574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:36.950059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] PATH_INFO: `/v3/users/24617d5be0d74280bc8b64496559e8cd` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:36.951770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24617d5be0d74280bc8b64496559e8cd)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:36.954308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:37.211996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24617d5be0d74280bc8b64496559e8cd'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:37.315711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24617d5be0d74280bc8b64496559e8cd'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:37.316849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24617d5be0d74280bc8b64496559e8cd'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:37.328942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24617d5be0d74280bc8b64496559e8cd'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:37.370864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24617d5be0d74280bc8b64496559e8cd'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:37.382121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 944/1875] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:36 2022] DELETE /identity/v3/users/24617d5be0d74280bc8b64496559e8cd => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:37.386473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:37.387015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:37.387123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:37.450054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:37.453188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:37.623354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 932/1876] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:37.663941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:37.668479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:37.785987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:37.813010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf10786-a5dd-453d-9433-c3f1dd7a9360 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:37.819135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ae91-556c-4fb4-b942-d5b43f03d88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:37.819620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ae91-556c-4fb4-b942-d5b43f03d88f service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:37.819902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ae91-556c-4fb4-b942-d5b43f03d88f service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:37.820320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ae91-556c-4fb4-b942-d5b43f03d88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:37.839553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ae91-556c-4fb4-b942-d5b43f03d88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:37.841258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ae91-556c-4fb4-b942-d5b43f03d88f service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:37.871152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 945/1877] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:40.153715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:40.155309 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:40.173198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a66e2-9b5b-42d2-a741-d6e77d339536 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:40.182210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:40.185459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:40.185786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:40.186252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] PATH_INFO: `/v3/projects/098cc98cb06a49e9902b2cd6b9d5c4c5` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:40.188256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=098cc98cb06a49e9902b2cd6b9d5c4c5)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:40.190262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:40.297217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098cc98cb06a49e9902b2cd6b9d5c4c5', 'request_id': 'req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:40.365761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098cc98cb06a49e9902b2cd6b9d5c4c5', 'request_id': 'req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:40.373456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098cc98cb06a49e9902b2cd6b9d5c4c5', 'request_id': 'req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:40.387571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] The token cache is being invalidate because project 098cc98cb06a49e9902b2cd6b9d5c4c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:40.388276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:40.389277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d74feff-e1a9-43e9-9dd7-bf645ba8e12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:40.390912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 933/1878] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:40 2022] DELETE /identity/v3/projects/098cc98cb06a49e9902b2cd6b9d5c4c5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:40.396012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49bf5-e774-4703-8a32-28a93d6e5ac9 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:40.397210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49bf5-e774-4703-8a32-28a93d6e5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:40.397687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49bf5-e774-4703-8a32-28a93d6e5ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:40.421044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-aeb49bf5-e774-4703-8a32-28a93d6e5ac9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:40.422578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-aeb49bf5-e774-4703-8a32-28a93d6e5ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:40.506572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 946/1879] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:56:40.509790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95878-50e9-4cb7-9946-18952bb970e5 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:40.510156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95878-50e9-4cb7-9946-18952bb970e5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:40.510499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95878-50e9-4cb7-9946-18952bb970e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:40.527645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:40.534538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-abf95878-50e9-4cb7-9946-18952bb970e5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:40.536946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-abf95878-50e9-4cb7-9946-18952bb970e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:40.552296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 934/1880] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:40.554073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49bf5-e774-4703-8a32-28a93d6e5ac9 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:40.567649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49bf5-e774-4703-8a32-28a93d6e5ac9 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:40.575930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:40.575930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:40.576210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:40.576417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:40.577747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:56:40.580260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:40.581553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:40.601860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 947/1881] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:56:40.603159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95878-50e9-4cb7-9946-18952bb970e5 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:40.618714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95878-50e9-4cb7-9946-18952bb970e5 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:40.624979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:40.628429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:40.628853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:40.629227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:40.630655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:40.634555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:40.764404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:40.776043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 935/1882] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:40 2022] POST /identity/v3/projects => generated 389 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:40.777958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ebb68-dc33-4f69-9c51-ea6db5b5f34a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:40.862058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:40.862710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:40.862988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:40.863254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:40.864078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:40.866908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:40.962534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:40.979229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 948/1883] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:40 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:40.990784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294252-70ce-49de-a203-aff37a173011 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:40.997408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:40.999302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:40.999302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:40.999302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:40.999302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:41.001572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:41.020413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 936/1884] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:41.020653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:41.031810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455edd-7dd1-47a7-902a-7af1e6ddca99 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:41.038645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde776dc-1203-4d64-b9bd-31927d5cde05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:41.039725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde776dc-1203-4d64-b9bd-31927d5cde05 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:41.040036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde776dc-1203-4d64-b9bd-31927d5cde05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:41.040376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde776dc-1203-4d64-b9bd-31927d5cde05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:41.041291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde776dc-1203-4d64-b9bd-31927d5cde05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:41.043002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde776dc-1203-4d64-b9bd-31927d5cde05 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:41.057114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 949/1885] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:56:41.062689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:41.078519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4ca5-e598-4051-a751-fbac8665fcff admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:41.084703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:41.085417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:41.085696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:41.087219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] PATH_INFO: `/v3/projects/331639538ae64348893b1db126e617d6/users/cdaea8cb26d149d0ba18c09a8cc90eb0/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:41.107276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=331639538ae64348893b1db126e617d6, user_id=cdaea8cb26d149d0ba18c09a8cc90eb0, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:41.110056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:41.190222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 937/1886] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:41 2022] PUT /identity/v3/projects/331639538ae64348893b1db126e617d6/users/cdaea8cb26d149d0ba18c09a8cc90eb0/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:56:41.200998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:41.201322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:41.201808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:41.233349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] MFA Rules not processed for user `cdaea8cb26d149d0ba18c09a8cc90eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:41.234553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:41.276500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:41.314661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 950/1887] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:56:41.353614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:41.356122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:41.435346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62447bf-cfdb-46e6-a179-2f06f2087637 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:41.440882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:41.441969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:41.442460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:41.442947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:41.453847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:41.455757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:41.470126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 938/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:51.224341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:51.227573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:51.397660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84a1ac-35d9-4fda-afb5-2ee067ae7a5c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:51.402891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:51.403719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:51.404001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:51.420398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] PATH_INFO: `/v3/users/e1c7fbdb29a24a11b719fb59c8f57cc3` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:51.420398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c7fbdb29a24a11b719fb59c8f57cc3)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:51.420398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:51.463481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:51.672565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c7fbdb29a24a11b719fb59c8f57cc3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:51.783255 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c7fbdb29a24a11b719fb59c8f57cc3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:51.784284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c7fbdb29a24a11b719fb59c8f57cc3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:51.800314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c7fbdb29a24a11b719fb59c8f57cc3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:51.828886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d4e48ef2-2158-401c-b6f6-423fe4356c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c7fbdb29a24a11b719fb59c8f57cc3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:51.838933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 951/1889] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:51 2022] DELETE /identity/v3/users/e1c7fbdb29a24a11b719fb59c8f57cc3 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:52.917676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:52.936287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f1351-2a4a-428a-9094-b7537bdfd502 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:53.042716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:53.044079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:53.044640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:53.045152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] PATH_INFO: `/v3/projects/52816e5f52fd412794bd5361bc627a82` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:53.046519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52816e5f52fd412794bd5361bc627a82)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:53.050414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:53.248081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52816e5f52fd412794bd5361bc627a82', 'request_id': 'req-e3856e84-d5db-473f-9d84-363c001ffd08'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:53.343279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52816e5f52fd412794bd5361bc627a82', 'request_id': 'req-e3856e84-d5db-473f-9d84-363c001ffd08'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:53.352334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52816e5f52fd412794bd5361bc627a82', 'request_id': 'req-e3856e84-d5db-473f-9d84-363c001ffd08'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:53.375532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] The token cache is being invalidate because project 52816e5f52fd412794bd5361bc627a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:53.376083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:53.376789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e3856e84-d5db-473f-9d84-363c001ffd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:53.378579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 939/1890] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:52 2022] DELETE /identity/v3/projects/52816e5f52fd412794bd5361bc627a82 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:53.383616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e20c-2f21-4e89-8676-b09a5e63eb8f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:53.384186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e20c-2f21-4e89-8676-b09a5e63eb8f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:53.384186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333e20c-2f21-4e89-8676-b09a5e63eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:53.408346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7333e20c-2f21-4e89-8676-b09a5e63eb8f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:53.410068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7333e20c-2f21-4e89-8676-b09a5e63eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:53.478501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:53.494119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 952/1891] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:53.503110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0628d-97f9-4794-8a7a-c710d69860f9 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:53.503712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0628d-97f9-4794-8a7a-c710d69860f9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:53.506519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0628d-97f9-4794-8a7a-c710d69860f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:53.538693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-dff0628d-97f9-4794-8a7a-c710d69860f9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:53.540233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-dff0628d-97f9-4794-8a7a-c710d69860f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:53.556338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e20c-2f21-4e89-8676-b09a5e63eb8f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:53.563464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 940/1892] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:53.568263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333e20c-2f21-4e89-8676-b09a5e63eb8f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:53.578589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:53.579614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:53.580064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:53.580547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:53.581187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:56:53.581665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:53.584065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:53.603195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 953/1893] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:56:53.608116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0628d-97f9-4794-8a7a-c710d69860f9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:53.628084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0628d-97f9-4794-8a7a-c710d69860f9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:53.634279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:53.635128 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:53.635531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:53.635877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:53.636611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:53.639076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:53.770694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 941/1894] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:53 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:53.774990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:53.795915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36b8a0-2bd9-4c4b-801d-69b46598e8a6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:53.871970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:53.872616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:53.872900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:53.873170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:53.873816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:53.875837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:53.975826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 954/1895] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:53 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:53.980288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:53.992747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002180e9-55e2-44c6-a4e5-0d3aac0fa42a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:53.998795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:53.999490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:53.999992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:54.000501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:54.001251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:54.003253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:54.020667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 942/1896] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:54.024892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:54.036769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401d5f6-c827-49e7-ab9a-a8a3d7043dfb admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:54.045108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abf403-5e23-4fd2-a01b-6d785ea2f404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:54.046151 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf403-5e23-4fd2-a01b-6d785ea2f404 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:54.046537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf403-5e23-4fd2-a01b-6d785ea2f404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:54.046929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abf403-5e23-4fd2-a01b-6d785ea2f404 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:54.047681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf403-5e23-4fd2-a01b-6d785ea2f404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:54.049452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abf403-5e23-4fd2-a01b-6d785ea2f404 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:54.062897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 955/1897] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:56:54.069126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:54.090027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a3023-28a4-453e-94f5-a0c59b2206a0 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:54.097514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:54.098604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:54.100032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:54.100615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] PATH_INFO: `/v3/projects/f468e8b0e9cc43c6b1eafbdddbab60f5/users/f49663a8e69d48319076d9e43b1e2641/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:54.130546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f468e8b0e9cc43c6b1eafbdddbab60f5, user_id=f49663a8e69d48319076d9e43b1e2641, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:54.134077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:54.259027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 943/1898] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:54 2022] PUT /identity/v3/projects/f468e8b0e9cc43c6b1eafbdddbab60f5/users/f49663a8e69d48319076d9e43b1e2641/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:56:54.269413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:54.271045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:54.271596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:54.295975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:54.298049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:54.341029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:54.362313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] MFA Rules not processed for user `f49663a8e69d48319076d9e43b1e2641`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:54.366983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:54.408034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82391d8-c9e6-4d54-9f6b-3baa93e805bb admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:54.419469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:54.420438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:54.420747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:54.421121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] PATH_INFO: `/v3/users/b205ccf553044988befaf5421aac5e36` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:54.425091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b205ccf553044988befaf5421aac5e36)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:54.429150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:54.532725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 956/1899] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:54.534452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:54.536207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:54.556884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b7f82-1a8c-4a08-ace9-070b4933fe22 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:54.564149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:54.565485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:54.565981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:54.567130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] PATH_INFO: `/v3/users/231abaa35f914e799ec1bb2b4f7e40a8` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:54.570019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231abaa35f914e799ec1bb2b4f7e40a8)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:54.573530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:54.746650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b205ccf553044988befaf5421aac5e36'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.868704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b205ccf553044988befaf5421aac5e36'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.885936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:54.889189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231abaa35f914e799ec1bb2b4f7e40a8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.899410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b205ccf553044988befaf5421aac5e36'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.900171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b205ccf553044988befaf5421aac5e36'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.929300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b205ccf553044988befaf5421aac5e36'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.941191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 944/1900] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:54 2022] DELETE /identity/v3/users/b205ccf553044988befaf5421aac5e36 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:54.942276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:54.945323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:54.971336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231abaa35f914e799ec1bb2b4f7e40a8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.972055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231abaa35f914e799ec1bb2b4f7e40a8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:54.983656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231abaa35f914e799ec1bb2b4f7e40a8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:55.014966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-266c39be-2ab1-4ebf-978b-78559e09b8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231abaa35f914e799ec1bb2b4f7e40a8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:55.046227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 957/1901] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:54 2022] DELETE /identity/v3/users/231abaa35f914e799ec1bb2b4f7e40a8 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:55.047746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:55.048049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:55.051037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:55.108985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:55.110923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:55.113822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24a3c-1a94-4b20-8f1a-fd1b4b5f0458 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:55.206018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 958/1902] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:55.239706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:55.244169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:55.252114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:55.252862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:55.253326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:55.253608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:55.254900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:55.257534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:55.373937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241e0cf-0d16-4dd5-bfe0-39cdaa03db89 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:55.379533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:55.380409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:55.380755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:55.381028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:55.418098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:55.422303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 945/1903] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:54 2022] POST /identity/v3/projects => generated 391 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:55.422862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:55.423592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:55.427249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:55.454617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 959/1904] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:55.531603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0420-a824-4f0a-9224-0d07ac2dae9a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:55.539847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:55.540399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:55.540678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:55.541186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:55.541849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:55.549010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:55.701238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 946/1905] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:55 2022] POST /identity/v3/users => generated 302 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:55.703438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:55.716240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cc1b-6bb3-401c-b77a-5f4839a6b7f5 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:55.724558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:55.725530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:55.726004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:55.727048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:55.727960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:55.730560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:55.744928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 960/1906] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:55.749275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:55.760760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219b556-51fa-42c1-9132-1c70a868f117 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:55.767465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:55.768101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:55.768441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:55.768777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] PATH_INFO: `/v3/projects/088cc91616b54174946b1c7e3ba69aa2/users/da4650c75ba0455da0a49cffd4de24a1/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:55.789757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=088cc91616b54174946b1c7e3ba69aa2, user_id=da4650c75ba0455da0a49cffd4de24a1, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:55.799212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:55.896521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:55.898428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:55.914652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:55.931015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5251e-4d58-4359-acb1-48aa46b4b0f8 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:55.936500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 947/1907] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:55 2022] PUT /identity/v3/projects/088cc91616b54174946b1c7e3ba69aa2/users/da4650c75ba0455da0a49cffd4de24a1/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:55.949540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:56.076772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:56.077768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.078153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.079147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] PATH_INFO: `/v3/projects/580605cfe10a4696bf5a3a3159e601ec` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.080619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=580605cfe10a4696bf5a3a3159e601ec)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:56.083570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:56.089476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a903f7-6c11-47fa-96ec-b007a6ccdb1c admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:56.112905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:56.114052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.114606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.116888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.118059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:56.126266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:56.142942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 948/1908] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:56.147445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:56.162652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83027c0-a899-44e7-b5c7-082fad4970de admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:56.177925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35508113-2f2d-4ad0-9ab4-a732b142b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:56.185805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508113-2f2d-4ad0-9ab4-a732b142b957 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.187979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508113-2f2d-4ad0-9ab4-a732b142b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.188556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35508113-2f2d-4ad0-9ab4-a732b142b957 admin admin] PATH_INFO: `/v3/projects/088cc91616b54174946b1c7e3ba69aa2/users/da4650c75ba0455da0a49cffd4de24a1/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.193059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35508113-2f2d-4ad0-9ab4-a732b142b957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088cc91616b54174946b1c7e3ba69aa2, user_id=da4650c75ba0455da0a49cffd4de24a1, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:56.200129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35508113-2f2d-4ad0-9ab4-a732b142b957 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:56.227702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 949/1909] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:56 2022] PUT /identity/v3/projects/088cc91616b54174946b1c7e3ba69aa2/users/da4650c75ba0455da0a49cffd4de24a1/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:56.241148 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.242124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.242608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.275662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580605cfe10a4696bf5a3a3159e601ec', 'request_id': 'req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:56.298215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] MFA Rules not processed for user `da4650c75ba0455da0a49cffd4de24a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:56.302622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:56.361241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580605cfe10a4696bf5a3a3159e601ec', 'request_id': 'req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:56.374414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580605cfe10a4696bf5a3a3159e601ec', 'request_id': 'req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:56.406802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] The token cache is being invalidate because project 580605cfe10a4696bf5a3a3159e601ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:56.407117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:56.411172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-35344a21-7b17-41a1-b7ae-ddeee5ae3a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:56.425590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 961/1910] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:55 2022] DELETE /identity/v3/projects/580605cfe10a4696bf5a3a3159e601ec => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:56:56.431242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca2e7-affb-4ffc-becd-d0aa9a8e91d2 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.431815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca2e7-affb-4ffc-becd-d0aa9a8e91d2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.432275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ca2e7-affb-4ffc-becd-d0aa9a8e91d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.498530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 950/1911] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:56.500886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-613ca2e7-affb-4ffc-becd-d0aa9a8e91d2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:56.502251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-613ca2e7-affb-4ffc-becd-d0aa9a8e91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:56.626638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:56.629153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:56.649672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 962/1912] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:56.657024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee371ed0-5d7c-47bb-bbdd-a27daa1d0138 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.657335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee371ed0-5d7c-47bb-bbdd-a27daa1d0138 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.657578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee371ed0-5d7c-47bb-bbdd-a27daa1d0138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.695655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ee371ed0-5d7c-47bb-bbdd-a27daa1d0138 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:56.697367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ee371ed0-5d7c-47bb-bbdd-a27daa1d0138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:56.717652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 963/1913] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:56:56.723791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee371ed0-5d7c-47bb-bbdd-a27daa1d0138 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:56.737529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee371ed0-5d7c-47bb-bbdd-a27daa1d0138 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:56.752409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:56.753623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.754011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.754399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.755607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:56:56.755986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:56.759198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:56.761097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552c8cc-383e-410d-937a-cfa864a33d9e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:56.767243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:56.767883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.768156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.768684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.772670 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:56.774792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 964/1914] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:56:56.779984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:56.805530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33e217-e0fd-43f7-b6c7-5c39cb171126 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:56.817160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:56.818700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:56.823540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:56.823540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:56.823540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:56.827336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:56.839999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:56.939937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:56.942089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:56.947597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 965/1915] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:56:56 2022] POST /identity/v3/projects => generated 397 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:56.951727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:56.980559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 951/1916] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:57.087167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0af43-1bae-4916-92c8-a78c6f00f30c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:57.092576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:57.093199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:57.093472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:57.093738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:57.094382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:57.101174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:57.321004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:57.324083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 966/1917] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:56:56 2022] POST /identity/v3/users => generated 299 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:56:57.335993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e6852-87bf-4848-90c0-2d9788c11b52 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:57.361547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:57.361547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:57.361547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:57.361547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:57.362067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:57.363887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:57.398465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:57.405718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 952/1918] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:57.416606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863f91-9add-471f-9715-9f457a1a10ff admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:57.425739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6a030-8394-4d1c-9da3-8c5af23821ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:57.426855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a030-8394-4d1c-9da3-8c5af23821ab admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:57.427140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a030-8394-4d1c-9da3-8c5af23821ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:57.427416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a030-8394-4d1c-9da3-8c5af23821ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:57.428081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6a030-8394-4d1c-9da3-8c5af23821ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:57.433406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6a030-8394-4d1c-9da3-8c5af23821ab admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:57.469393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 967/1919] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:56:57.478043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:57.497866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b209-a03e-468b-bbba-4c5f096b47e2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:57.514469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:57.515513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:57.515953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:57.516233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] PATH_INFO: `/v3/projects/4182339dba9a442e80900cdb4fcd5848/users/62555a9746a44dd3b31653569d1f851f/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:57.553845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4182339dba9a442e80900cdb4fcd5848, user_id=62555a9746a44dd3b31653569d1f851f, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:57.557154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:57.681310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 953/1920] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:56:57 2022] PUT /identity/v3/projects/4182339dba9a442e80900cdb4fcd5848/users/62555a9746a44dd3b31653569d1f851f/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:57.692722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:57.693018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:57.693295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:57.804303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] MFA Rules not processed for user `62555a9746a44dd3b31653569d1f851f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:56:57.807797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:57.942648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:57.976262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 968/1921] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:56:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:56:58.014466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:58.017190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:58.165042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec9107-e668-4e4d-9059-c925fe3694b7 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:58.165042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:58.165042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:58.165042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:58.165631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:58.191743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:58.193233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:58.214730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 954/1922] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:56:58 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:56:58.421636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:58.423332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:56:58.583611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c504d-27ce-41e3-91b7-48c0fc5b0e1b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:58.589792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:58.594254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:58.595034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:58.595487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:58.595820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] PATH_INFO: `/v3/projects/23b55469f48b4870b1e2c57a1aa8de60` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:58.597111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b55469f48b4870b1e2c57a1aa8de60)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:58.601850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:58.777806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b55469f48b4870b1e2c57a1aa8de60', 'request_id': 'req-99a78334-c3e3-4280-a561-bad73f59e451'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:58.902854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b55469f48b4870b1e2c57a1aa8de60', 'request_id': 'req-99a78334-c3e3-4280-a561-bad73f59e451'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:58.921049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:58.927841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b55469f48b4870b1e2c57a1aa8de60', 'request_id': 'req-99a78334-c3e3-4280-a561-bad73f59e451'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:58.960543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] The token cache is being invalidate because project 23b55469f48b4870b1e2c57a1aa8de60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:56:58.960691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:58.969579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:58.971840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 969/1923] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:58 2022] DELETE /identity/v3/projects/23b55469f48b4870b1e2c57a1aa8de60 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:56:58.975994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:56:58.995849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acdbe2-ff74-4fc7-b15d-0501ba3aa149 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:56:59.136202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:56:59.137042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:56:59.141514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:56:59.142048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] PATH_INFO: `/v3/users/b8170812dd1b4c20bb07d3ac6a86d998` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:56:59.143867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8170812dd1b4c20bb07d3ac6a86d998)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:56:59.146074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:56:59.409111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8170812dd1b4c20bb07d3ac6a86d998'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:59.525459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8170812dd1b4c20bb07d3ac6a86d998'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:59.551198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8170812dd1b4c20bb07d3ac6a86d998'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:59.555146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8170812dd1b4c20bb07d3ac6a86d998'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:59.567019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-020d2204-151c-49a9-b71e-543f3af6bbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8170812dd1b4c20bb07d3ac6a86d998'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:56:59.576851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 955/1924] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:56:58 2022] DELETE /identity/v3/users/b8170812dd1b4c20bb07d3ac6a86d998 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:00.336977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:00.764087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:00.767056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:00.786440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a78334-c3e3-4280-a561-bad73f59e451 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:00.898965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:00.899998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:00.900394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:00.900746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] PATH_INFO: `/v3/projects/fafff247268b48ddb6f898503ef047cc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:00.903087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafff247268b48ddb6f898503ef047cc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:00.911238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:01.120213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafff247268b48ddb6f898503ef047cc', 'request_id': 'req-ae8a1a29-393f-413a-8a5b-3a72f1f31657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:01.222499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafff247268b48ddb6f898503ef047cc', 'request_id': 'req-ae8a1a29-393f-413a-8a5b-3a72f1f31657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:01.231431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafff247268b48ddb6f898503ef047cc', 'request_id': 'req-ae8a1a29-393f-413a-8a5b-3a72f1f31657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:01.264097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] The token cache is being invalidate because project fafff247268b48ddb6f898503ef047cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:01.264998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:01.265716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae8a1a29-393f-413a-8a5b-3a72f1f31657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:01.271274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 970/1925] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:00 2022] DELETE /identity/v3/projects/fafff247268b48ddb6f898503ef047cc => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:01.274217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4abeb3-2328-4f7e-bf2a-c83fac5fba9e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:01.277609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4abeb3-2328-4f7e-bf2a-c83fac5fba9e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:01.277609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4abeb3-2328-4f7e-bf2a-c83fac5fba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:01.325825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7e4abeb3-2328-4f7e-bf2a-c83fac5fba9e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:01.327885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7e4abeb3-2328-4f7e-bf2a-c83fac5fba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:01.445702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:01.477617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 956/1926] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:01.478552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ac9b7-52e8-4a3e-847b-64c9098dbb21 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:01.479078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ac9b7-52e8-4a3e-847b-64c9098dbb21 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:01.479161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ac9b7-52e8-4a3e-847b-64c9098dbb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:01.511343 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-503ac9b7-52e8-4a3e-847b-64c9098dbb21 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:01.511343 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-503ac9b7-52e8-4a3e-847b-64c9098dbb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:01.523991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 971/1927] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:01.528347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4abeb3-2328-4f7e-bf2a-c83fac5fba9e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:01.543026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4abeb3-2328-4f7e-bf2a-c83fac5fba9e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:01.551947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:01.553080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:01.553561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:01.554028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:01.555788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:01.556320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:01.559778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:01.582138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 957/1928] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:01.582579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ac9b7-52e8-4a3e-847b-64c9098dbb21 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:01.595410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ac9b7-52e8-4a3e-847b-64c9098dbb21 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:01.607433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:01.608653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:01.609156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:01.609535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:01.610653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:01.612885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:01.745301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 972/1929] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:01 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:01.749179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:01.762042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1742dc-dfde-4e4e-b3ef-6f4e17123607 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:01.854522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:01.855299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:01.855567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:01.856055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:01.856795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:01.859034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:01.992787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 958/1930] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:01 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:01.996294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:02.010587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26b0d3-3c94-4c2b-9a9c-12b499ce99d5 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:02.020316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:02.021380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:02.021906 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:02.022323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:02.023218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:02.025282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:02.047579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 973/1931] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:02.051733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:02.062652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9a319-e390-4ade-a244-754d65e54269 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:02.069068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a0e09-8203-48f2-84df-2fd0100a6464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:02.069707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a0e09-8203-48f2-84df-2fd0100a6464 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:02.069983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a0e09-8203-48f2-84df-2fd0100a6464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:02.070250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a0e09-8203-48f2-84df-2fd0100a6464 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:02.070932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a0e09-8203-48f2-84df-2fd0100a6464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:02.072629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a0e09-8203-48f2-84df-2fd0100a6464 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:02.101027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 959/1932] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:02.105539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:02.120409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd759354-792d-4cec-bafe-41120743381b admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:02.128217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:02.129963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:02.130348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:02.131236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] PATH_INFO: `/v3/projects/df05570738934ede8054e992661f5ba0/users/fe78a0198851465e8c26519ead756188/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:02.158884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df05570738934ede8054e992661f5ba0, user_id=fe78a0198851465e8c26519ead756188, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:02.165079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:02.268152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 974/1933] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:02 2022] PUT /identity/v3/projects/df05570738934ede8054e992661f5ba0/users/fe78a0198851465e8c26519ead756188/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:02.278710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a84b1d-f820-47ef-90c1-4a238628aa77 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:02.279260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a84b1d-f820-47ef-90c1-4a238628aa77 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:02.279260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a84b1d-f820-47ef-90c1-4a238628aa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:02.324881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-67a84b1d-f820-47ef-90c1-4a238628aa77 None None] MFA Rules not processed for user `fe78a0198851465e8c26519ead756188`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:02.326411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-67a84b1d-f820-47ef-90c1-4a238628aa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:02.435288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 960/1934] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:02.436029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:02.450987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:02.554836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1040-3e00-4c8b-9648-87eaaf402073 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:02.574212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:02.574883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:02.575158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:02.575421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:02.576088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:02.578120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:02.710493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a84b1d-f820-47ef-90c1-4a238628aa77 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:02.721289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 975/1935] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:02 2022] POST /identity/v3/projects => generated 391 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:02.746130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a84b1d-f820-47ef-90c1-4a238628aa77 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:02.892246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:02.893054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:02.893627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:02.894028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:02.895465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:02.898449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:03.038797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 961/1936] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:02 2022] POST /identity/v3/users => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:03.039958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:03.060062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389fa58-0f26-44a1-a0db-7b39f96acd8d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:03.066969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:03.067876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:03.069600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:03.070936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:03.072133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:03.075610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:03.090894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 976/1937] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:03.100169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:03.119222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bee59-81c8-4e1c-a94e-e822c87f57dd admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:03.127554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:03.127849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:03.128047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:03.128337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] PATH_INFO: `/v3/projects/e8ca3613e3bf46caba5e37ae283527af/users/6b07c3230e3a4c96be45f4c21ce89f53/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:03.148652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ca3613e3bf46caba5e37ae283527af, user_id=6b07c3230e3a4c96be45f4c21ce89f53, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:03.152087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:03.299247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 962/1938] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:03 2022] PUT /identity/v3/projects/e8ca3613e3bf46caba5e37ae283527af/users/6b07c3230e3a4c96be45f4c21ce89f53/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:03.299914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:03.312862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02339c93-b31e-4f27-ad29-a082d187e571 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:03.320997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:03.406609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18c9b0-8fd0-46aa-a537-38732d7ab022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:03.407617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18c9b0-8fd0-46aa-a537-38732d7ab022 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:03.408141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18c9b0-8fd0-46aa-a537-38732d7ab022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:03.408817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18c9b0-8fd0-46aa-a537-38732d7ab022 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:03.410520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18c9b0-8fd0-46aa-a537-38732d7ab022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:03.412614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18c9b0-8fd0-46aa-a537-38732d7ab022 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:03.434167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 977/1939] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:03.437520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:03.449238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f3ea-3ad1-473a-ade7-ccb0b6d23904 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:03.455810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:03.456823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:03.457279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:03.457729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] PATH_INFO: `/v3/projects/e8ca3613e3bf46caba5e37ae283527af/users/6b07c3230e3a4c96be45f4c21ce89f53/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:03.460210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ca3613e3bf46caba5e37ae283527af, user_id=6b07c3230e3a4c96be45f4c21ce89f53, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:03.463392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:03.487213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 963/1940] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:03 2022] PUT /identity/v3/projects/e8ca3613e3bf46caba5e37ae283527af/users/6b07c3230e3a4c96be45f4c21ce89f53/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:03.490689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:03.491075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:03.491452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:03.525914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] MFA Rules not processed for user `6b07c3230e3a4c96be45f4c21ce89f53`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:03.527630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:03.634409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 978/1941] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:03.673817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:03.676562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:03.920994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa1587-9758-4134-92d8-76ec3d2bd685 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:03.933586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:03.934241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:03.934501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:03.934817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:03.962475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:03.962475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:03.990008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 964/1942] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:07.356132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:07.358694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:07.379049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:07.399480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164beca5-e12e-48bb-b969-f28aff86fd36 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:07.411494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3204478-5d61-47dc-a496-c46cfbe6c7c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:07.412626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204478-5d61-47dc-a496-c46cfbe6c7c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:07.423496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204478-5d61-47dc-a496-c46cfbe6c7c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:07.432327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204478-5d61-47dc-a496-c46cfbe6c7c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:07.443918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b3204478-5d61-47dc-a496-c46cfbe6c7c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:07.577554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3204478-5d61-47dc-a496-c46cfbe6c7c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:07.579346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3204478-5d61-47dc-a496-c46cfbe6c7c7 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:07.597617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 979/1943] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:57:13.011299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.109171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114198b2-d434-4748-a8c2-45c1008bb22b service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.116202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.117659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.118031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.125878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] PATH_INFO: `/v3/users/fe78a0198851465e8c26519ead756188` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.125878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe78a0198851465e8c26519ead756188)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.125878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.395252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:13.400304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe78a0198851465e8c26519ead756188'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:13.496470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe78a0198851465e8c26519ead756188'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:13.513996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe78a0198851465e8c26519ead756188'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:13.514681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe78a0198851465e8c26519ead756188'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:13.524634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe78a0198851465e8c26519ead756188'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:13.531722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 965/1944] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:13 2022] DELETE /identity/v3/users/fe78a0198851465e8c26519ead756188 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:13.537557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.538220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.538220 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.586179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:13.587480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.698826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 980/1945] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:13.771196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:13.772774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:13.842873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb270805-26cd-4ff4-8e23-75b5fc130137 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:13.847464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:13.848078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:13.848350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:13.848780 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:13.859980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:13.861789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:13.877721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 966/1946] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:15.663964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:15.668444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:15.681415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae15316-1050-4510-96f5-f8dcfd7b892f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:15.687133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:15.688043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:15.688607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:15.689193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] PATH_INFO: `/v3/projects/df05570738934ede8054e992661f5ba0` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:15.694684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df05570738934ede8054e992661f5ba0)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:15.694684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:15.879146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df05570738934ede8054e992661f5ba0', 'request_id': 'req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:15.948061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df05570738934ede8054e992661f5ba0', 'request_id': 'req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:15.957876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df05570738934ede8054e992661f5ba0', 'request_id': 'req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:15.975705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] The token cache is being invalidate because project df05570738934ede8054e992661f5ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:15.975705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:15.975705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:15.982970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 981/1947] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:15 2022] DELETE /identity/v3/projects/df05570738934ede8054e992661f5ba0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:15.984276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:16.000563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98b436-61aa-49bf-81b2-2377508ea11f service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:16.109995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:16.110812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.111222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.111568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] PATH_INFO: `/v3/users/6b07c3230e3a4c96be45f4c21ce89f53` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.113346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b07c3230e3a4c96be45f4c21ce89f53)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:16.116075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:16.356355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b07c3230e3a4c96be45f4c21ce89f53'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.428768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b07c3230e3a4c96be45f4c21ce89f53'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.453175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:16.457059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b07c3230e3a4c96be45f4c21ce89f53'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.458134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b07c3230e3a4c96be45f4c21ce89f53'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.467260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4ad0afca-1e91-44cd-8dc8-2b2a5f86285b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b07c3230e3a4c96be45f4c21ce89f53'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:16.478226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 967/1948] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:15 2022] DELETE /identity/v3/users/6b07c3230e3a4c96be45f4c21ce89f53 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:16.739412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:16.741137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:16.757026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bf2d5-8000-4f03-9a1f-f8bb1aa5c056 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:16.777471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:16.824321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:16.825324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:16.825901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:16.826340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] PATH_INFO: `/v3/users/f49663a8e69d48319076d9e43b1e2641` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:16.827724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49663a8e69d48319076d9e43b1e2641)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:16.829833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:17.036249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49663a8e69d48319076d9e43b1e2641'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.132772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49663a8e69d48319076d9e43b1e2641'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.132772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49663a8e69d48319076d9e43b1e2641'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.139890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49663a8e69d48319076d9e43b1e2641'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.162045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49663a8e69d48319076d9e43b1e2641'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.169101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 982/1949] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:16 2022] DELETE /identity/v3/users/f49663a8e69d48319076d9e43b1e2641 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:17.174015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.175548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.175828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.197179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:17.209345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:17.223478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:17.226734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:17.347100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 968/1950] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:17.385072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:17.385072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:17.418374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cb0f1-9edf-4107-8fa8-7497d051461d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:17.427488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:17.428407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.428991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.429570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] PATH_INFO: `/v3/projects/e8ca3613e3bf46caba5e37ae283527af` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.431021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ca3613e3bf46caba5e37ae283527af)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:17.434108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:17.525153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fd2f5-2b5f-468c-b4b6-a4e2338927f3 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:17.537354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4adc71-a39e-4e9c-b5fd-de2b28307579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:17.537995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adc71-a39e-4e9c-b5fd-de2b28307579 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.538277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adc71-a39e-4e9c-b5fd-de2b28307579 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.538550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4adc71-a39e-4e9c-b5fd-de2b28307579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.557707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4adc71-a39e-4e9c-b5fd-de2b28307579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:17.559853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4adc71-a39e-4e9c-b5fd-de2b28307579 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:17.572453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 969/1951] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:17.640640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ca3613e3bf46caba5e37ae283527af', 'request_id': 'req-b21b0d95-99ab-4f3a-971f-3414fb7f5342'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.708375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ca3613e3bf46caba5e37ae283527af', 'request_id': 'req-b21b0d95-99ab-4f3a-971f-3414fb7f5342'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.719976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ca3613e3bf46caba5e37ae283527af', 'request_id': 'req-b21b0d95-99ab-4f3a-971f-3414fb7f5342'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.747199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] The token cache is being invalidate because project e8ca3613e3bf46caba5e37ae283527af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:17.748644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.751057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b21b0d95-99ab-4f3a-971f-3414fb7f5342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:17.758171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 983/1952] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:17 2022] DELETE /identity/v3/projects/e8ca3613e3bf46caba5e37ae283527af => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:17.765013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886b63a-1491-4930-af97-80f04601fd19 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.765399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886b63a-1491-4930-af97-80f04601fd19 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.765897 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886b63a-1491-4930-af97-80f04601fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.796892 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e886b63a-1491-4930-af97-80f04601fd19 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:17.798490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e886b63a-1491-4930-af97-80f04601fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:17.863779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:17.915249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 970/1953] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:17.926068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f295177-10b1-4690-b601-cd0934bb3647 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.926847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f295177-10b1-4690-b601-cd0934bb3647 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.927062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f295177-10b1-4690-b601-cd0934bb3647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.952050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3f295177-10b1-4690-b601-cd0934bb3647 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:17.953601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3f295177-10b1-4690-b601-cd0934bb3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:17.967521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 984/1954] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:17.978977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886b63a-1491-4930-af97-80f04601fd19 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:17.987898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886b63a-1491-4930-af97-80f04601fd19 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:17.994710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:17.995440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:17.995781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:17.996169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:17.998199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:17.998719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.000669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.025634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 971/1955] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:18.031066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f295177-10b1-4690-b601-cd0934bb3647 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.043369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f295177-10b1-4690-b601-cd0934bb3647 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.052117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.052897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.053273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.054138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.055008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.056779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.161675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 985/1956] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:18.165487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.177839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e204a-6ab0-4b24-87aa-d57ec629ba47 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.193589 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:18.268988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.269880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.270405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.270824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.271859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.274313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.392005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 972/1957] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:18.397218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.418395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1741-0932-42fb-9504-43be09a0c560 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.423531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.425658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.425823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.426077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.426914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.430233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.444396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 986/1958] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:18.448031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.459776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d2e11-9b2c-4a7d-9837-4379c2720d7f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.467575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7fb3-09a6-4674-bcd1-d5dcc6b4fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.468234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7fb3-09a6-4674-bcd1-d5dcc6b4fc79 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.468487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7fb3-09a6-4674-bcd1-d5dcc6b4fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.468755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7fb3-09a6-4674-bcd1-d5dcc6b4fc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.472450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e7fb3-09a6-4674-bcd1-d5dcc6b4fc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.477389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e7fb3-09a6-4674-bcd1-d5dcc6b4fc79 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.493567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 973/1959] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:18.497725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.509479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0db029-49c0-43ee-b339-c9ce4d391253 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:18.515818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:18.516781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.517623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.518993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] PATH_INFO: `/v3/projects/25a1ece53cc94768b28900845d6f215a/users/8c29a86ed0ba45c18666b029b259708c/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.555126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a1ece53cc94768b28900845d6f215a, user_id=8c29a86ed0ba45c18666b029b259708c, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:18.555126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:18.634554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 987/1960] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:18 2022] PUT /identity/v3/projects/25a1ece53cc94768b28900845d6f215a/users/8c29a86ed0ba45c18666b029b259708c/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:18.653510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:18.653958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:18.654409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:18.702576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] MFA Rules not processed for user `8c29a86ed0ba45c18666b029b259708c`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:18.703898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:18.872276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 974/1961] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:18.889815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.891691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:18.989981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:18.991688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:19.013259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f64dcb-8ec8-4c6d-b617-8758a133db8c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.022661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.024417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.024861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.025517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.041418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.044088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.068447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 988/1962] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:19.121824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d92ffe-50ec-42bf-ae23-ceecc311ecb6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.128395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.149180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.149180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.149180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] PATH_INFO: `/v3/projects/f468e8b0e9cc43c6b1eafbdddbab60f5` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.149180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f468e8b0e9cc43c6b1eafbdddbab60f5)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.149180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.276828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:19.315477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f468e8b0e9cc43c6b1eafbdddbab60f5', 'request_id': 'req-b2f61561-b1af-46df-9ba9-9d1622ce0674'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.392450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f468e8b0e9cc43c6b1eafbdddbab60f5', 'request_id': 'req-b2f61561-b1af-46df-9ba9-9d1622ce0674'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.407145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f468e8b0e9cc43c6b1eafbdddbab60f5', 'request_id': 'req-b2f61561-b1af-46df-9ba9-9d1622ce0674'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.442760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] The token cache is being invalidate because project f468e8b0e9cc43c6b1eafbdddbab60f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:19.443371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.444480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:19.447833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 975/1963] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:18 2022] DELETE /identity/v3/projects/f468e8b0e9cc43c6b1eafbdddbab60f5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:19.453134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:19.469254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17622f-3069-432d-8582-e149369ab1e7 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:19.550544 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:19.551291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:19.551576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:19.551847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] PATH_INFO: `/v3/users/da4650c75ba0455da0a49cffd4de24a1` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:19.553287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4650c75ba0455da0a49cffd4de24a1)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:19.557173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:19.598788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:19.847803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4650c75ba0455da0a49cffd4de24a1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.015454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4650c75ba0455da0a49cffd4de24a1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.016495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4650c75ba0455da0a49cffd4de24a1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.025446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4650c75ba0455da0a49cffd4de24a1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.041854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-77cc7877-976e-4ab5-be2c-00c1032f6c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4650c75ba0455da0a49cffd4de24a1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:20.056367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 989/1964] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:19 2022] DELETE /identity/v3/users/da4650c75ba0455da0a49cffd4de24a1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:21.868778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:21.870288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:21.897194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f61561-b1af-46df-9ba9-9d1622ce0674 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:22.078769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:22.079034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.079428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.079707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] PATH_INFO: `/v3/projects/088cc91616b54174946b1c7e3ba69aa2` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.082781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=088cc91616b54174946b1c7e3ba69aa2)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:22.086092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:22.269459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088cc91616b54174946b1c7e3ba69aa2', 'request_id': 'req-91c0c54b-f15f-4645-a631-24e763d99c0a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.369018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088cc91616b54174946b1c7e3ba69aa2', 'request_id': 'req-91c0c54b-f15f-4645-a631-24e763d99c0a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.384228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088cc91616b54174946b1c7e3ba69aa2', 'request_id': 'req-91c0c54b-f15f-4645-a631-24e763d99c0a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.404540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] The token cache is being invalidate because project 088cc91616b54174946b1c7e3ba69aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:22.405009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.406526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-91c0c54b-f15f-4645-a631-24e763d99c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:22.408579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 976/1965] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:21 2022] DELETE /identity/v3/projects/088cc91616b54174946b1c7e3ba69aa2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:22.413150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e316-f334-4e4e-9db0-c564c7f799d7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.413985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e316-f334-4e4e-9db0-c564c7f799d7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.414422 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947e316-f334-4e4e-9db0-c564c7f799d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.436924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1947e316-f334-4e4e-9db0-c564c7f799d7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:22.438367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1947e316-f334-4e4e-9db0-c564c7f799d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:22.518983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb735-43e2-4f6a-964c-bfbcd9a691e6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.519511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb735-43e2-4f6a-964c-bfbcd9a691e6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.519933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdb735-43e2-4f6a-964c-bfbcd9a691e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.522868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 990/1966] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:22.550935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-3ecdb735-43e2-4f6a-964c-bfbcd9a691e6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:22.552270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3ecdb735-43e2-4f6a-964c-bfbcd9a691e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:22.571485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947e316-f334-4e4e-9db0-c564c7f799d7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:22.571624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 977/1967] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:22.581825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947e316-f334-4e4e-9db0-c564c7f799d7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:22.587383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:22.588518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.590797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.590797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.590797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:22.590797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:22.592606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:22.616366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb735-43e2-4f6a-964c-bfbcd9a691e6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:22.627319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 991/1968] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:57:22.641638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdb735-43e2-4f6a-964c-bfbcd9a691e6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:22.650451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:22.652083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.652768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.652768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.653502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:22.657122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:22.778290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 978/1969] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:22 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:22.781727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:22.796197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63401c3a-6815-4f7a-96a0-88f9a903b305 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:22.888676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:22.889737 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:22.890175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:22.890649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:22.891487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:22.894394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.026188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 992/1970] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:22 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:23.029559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.053053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbbc9b-97a2-41d8-b7e8-185ffacd7dab admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.063285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.064346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.064662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.065208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.065968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.078615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.097524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.097771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 979/1971] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:23.111711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:23.121385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680b622-38ff-420b-b943-432ee5cb3bc1 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.127484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9569-46c3-469a-b98c-ae2b7a1268c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.129554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9569-46c3-469a-b98c-ae2b7a1268c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.129897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9569-46c3-469a-b98c-ae2b7a1268c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.130182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9569-46c3-469a-b98c-ae2b7a1268c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.131392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9569-46c3-469a-b98c-ae2b7a1268c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.134208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9569-46c3-469a-b98c-ae2b7a1268c2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.179172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 993/1972] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:23.179326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.186749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:23.195672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c6d11-bcef-4308-8d49-cc327759cecd admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.207906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.210629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.210629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.210629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] PATH_INFO: `/v3/projects/416aacf433dd43e9bde1833d171d0e07/users/a701930f2f9a4015867dbee9961fd3d9/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.245732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416aacf433dd43e9bde1833d171d0e07, user_id=a701930f2f9a4015867dbee9961fd3d9, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.248899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.371845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 980/1973] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:23 2022] PUT /identity/v3/projects/416aacf433dd43e9bde1833d171d0e07/users/a701930f2f9a4015867dbee9961fd3d9/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:23.383909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f1dd-8249-43ad-8899-b6ddcad46b74 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.384644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f1dd-8249-43ad-8899-b6ddcad46b74 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.384927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f1dd-8249-43ad-8899-b6ddcad46b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.441065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-5ba6f1dd-8249-43ad-8899-b6ddcad46b74 None None] MFA Rules not processed for user `a701930f2f9a4015867dbee9961fd3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:23.442349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5ba6f1dd-8249-43ad-8899-b6ddcad46b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:23.530594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 994/1974] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:23.535258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.633096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f48ba-7a9d-479c-9db4-a30733942fc0 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.638644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.639303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.639582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.639853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.640513 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.642483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:23.796111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 981/1975] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:23 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:23.800606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6f1dd-8249-43ad-8899-b6ddcad46b74 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:23.818531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6f1dd-8249-43ad-8899-b6ddcad46b74 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:23.906296 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:23.907138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:23.907535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:23.907910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:23.910140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:23.918057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.024138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 995/1976] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:23 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:24.025536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.042061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b21c94-e8c9-4ecb-86c6-d753d7518d29 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.048666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.050453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.050453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.050453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.050906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.052612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.069912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 982/1977] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:24.070572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.089421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5ab83-a8fb-4328-a191-dd67ee3082f5 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.103561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.104331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.104649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.104885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] PATH_INFO: `/v3/projects/b40109cf8c9445bd9177053c230110ac/users/d9b7252d86d745fbbe75f8973a570932/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.124847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40109cf8c9445bd9177053c230110ac, user_id=d9b7252d86d745fbbe75f8973a570932, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.128360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.240342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 996/1978] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:24 2022] PUT /identity/v3/projects/b40109cf8c9445bd9177053c230110ac/users/d9b7252d86d745fbbe75f8973a570932/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:24.245746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.265592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e4fe0-6345-4cb7-a13f-d638429952d5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.351803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856e3ee-e141-45d8-8935-9b800b002846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.352862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e3ee-e141-45d8-8935-9b800b002846 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.353222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e3ee-e141-45d8-8935-9b800b002846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.354201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856e3ee-e141-45d8-8935-9b800b002846 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.354201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856e3ee-e141-45d8-8935-9b800b002846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.356122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856e3ee-e141-45d8-8935-9b800b002846 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.375327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 983/1979] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:24.379469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.395960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302e562-4232-4f35-a7a0-0f835a6bb028 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.402020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.403103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.404122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.404566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] PATH_INFO: `/v3/projects/b40109cf8c9445bd9177053c230110ac/users/d9b7252d86d745fbbe75f8973a570932/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.407598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40109cf8c9445bd9177053c230110ac, user_id=d9b7252d86d745fbbe75f8973a570932, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.411267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.429148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 997/1980] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:24 2022] PUT /identity/v3/projects/b40109cf8c9445bd9177053c230110ac/users/d9b7252d86d745fbbe75f8973a570932/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:24.456171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.459949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.460435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.525783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] MFA Rules not processed for user `d9b7252d86d745fbbe75f8973a570932`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:24.527066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:24.617658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 984/1981] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:24.660086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:24.666240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:24.809663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b1bc7-2ff3-4e99-bb3d-ac7bc51ca8c9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:24.820546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77bf96-13d8-44f2-8dee-c1baa2f614f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:24.823439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77bf96-13d8-44f2-8dee-c1baa2f614f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:24.824863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77bf96-13d8-44f2-8dee-c1baa2f614f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:24.825578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77bf96-13d8-44f2-8dee-c1baa2f614f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:24.851837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77bf96-13d8-44f2-8dee-c1baa2f614f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:24.858027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77bf96-13d8-44f2-8dee-c1baa2f614f8 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:24.911400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 998/1982] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:24.930405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:25.130151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:26.673031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:26.676636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:26.790135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3ef5-245d-4c58-b7eb-52608ea3110d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:26.797659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:26.799879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:26.800737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:26.802048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] PATH_INFO: `/v3/users/a23157a4698e45438c333fcb3038e978` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:26.805537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23157a4698e45438c333fcb3038e978)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:26.807522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:27.115005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23157a4698e45438c333fcb3038e978'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:27.198563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23157a4698e45438c333fcb3038e978'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:27.228140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23157a4698e45438c333fcb3038e978'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:27.229586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23157a4698e45438c333fcb3038e978'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:27.239968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23157a4698e45438c333fcb3038e978'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:27.255264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 985/1983] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:26 2022] DELETE /identity/v3/users/a23157a4698e45438c333fcb3038e978 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:27.258350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:27.259387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:27.260189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:27.291263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:27.298111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:27.424979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 999/1984] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:27.445166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:27.447716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:27.568510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62329026-2dbc-454d-b568-0060bc80ed28 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:27.576452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d88a-e350-4ba3-93be-0256f6f082bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:27.577142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d88a-e350-4ba3-93be-0256f6f082bc service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:27.577424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d88a-e350-4ba3-93be-0256f6f082bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:27.577696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d88a-e350-4ba3-93be-0256f6f082bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:27.602748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:27.604968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d88a-e350-4ba3-93be-0256f6f082bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:27.606145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:27.606302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d88a-e350-4ba3-93be-0256f6f082bc service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:27.615725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:27.624678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 986/1985] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:27.636150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d70b0-dbae-409b-89e1-b7e860694e86 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:27.649900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:27.651035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:27.653245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:27.654714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] PATH_INFO: `/v3/users/cdaea8cb26d149d0ba18c09a8cc90eb0` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:27.659867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdaea8cb26d149d0ba18c09a8cc90eb0)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:27.667065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:27.941847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdaea8cb26d149d0ba18c09a8cc90eb0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:28.021631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdaea8cb26d149d0ba18c09a8cc90eb0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:28.022301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdaea8cb26d149d0ba18c09a8cc90eb0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:28.035385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdaea8cb26d149d0ba18c09a8cc90eb0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:28.074914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdaea8cb26d149d0ba18c09a8cc90eb0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:28.094063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1000/1986] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:27 2022] DELETE /identity/v3/users/cdaea8cb26d149d0ba18c09a8cc90eb0 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:28.099248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:28.099729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:28.108336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:28.148950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:28.156416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:28.311291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 987/1987] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:28.352667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:28.356346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:28.486148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da473-a472-4592-b301-4c687d17f75a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:28.491712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56421f-4986-4639-b541-cd6f1fcd988c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:28.492831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56421f-4986-4639-b541-cd6f1fcd988c service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:28.493140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56421f-4986-4639-b541-cd6f1fcd988c service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:28.493677 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56421f-4986-4639-b541-cd6f1fcd988c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:28.509696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:28.516840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56421f-4986-4639-b541-cd6f1fcd988c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:28.519462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56421f-4986-4639-b541-cd6f1fcd988c service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:28.554002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1001/1988] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:28.927474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:28.929430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:28.947723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b33d-5c58-480b-8a19-bcaecafc9544 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:28.954519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:28.956190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:28.957844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:28.958285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] PATH_INFO: `/v3/projects/75ecfc91f5d047d6aba3e42bd3b79869` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:28.963498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ecfc91f5d047d6aba3e42bd3b79869)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:28.969824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:29.120369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ecfc91f5d047d6aba3e42bd3b79869', 'request_id': 'req-64995d9e-2ba8-4423-868f-82140c030d6c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:29.296999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ecfc91f5d047d6aba3e42bd3b79869', 'request_id': 'req-64995d9e-2ba8-4423-868f-82140c030d6c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:29.311569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ecfc91f5d047d6aba3e42bd3b79869', 'request_id': 'req-64995d9e-2ba8-4423-868f-82140c030d6c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:29.333830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] The token cache is being invalidate because project 75ecfc91f5d047d6aba3e42bd3b79869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:29.335869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:29.343789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-64995d9e-2ba8-4423-868f-82140c030d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:29.348287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 988/1989] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:28 2022] DELETE /identity/v3/projects/75ecfc91f5d047d6aba3e42bd3b79869 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:29.354791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbf7f-c436-4dfa-aa8b-5e1953ff4d33 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:29.359768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbf7f-c436-4dfa-aa8b-5e1953ff4d33 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:29.359768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcbf7f-c436-4dfa-aa8b-5e1953ff4d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:29.392049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f5fcbf7f-c436-4dfa-aa8b-5e1953ff4d33 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:29.402071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f5fcbf7f-c436-4dfa-aa8b-5e1953ff4d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:29.564877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1002/1990] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:29.569272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc7d0-8e63-4eba-be4b-4b3a2568aa54 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:29.569864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc7d0-8e63-4eba-be4b-4b3a2568aa54 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:29.570346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dc7d0-8e63-4eba-be4b-4b3a2568aa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:29.604762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-fb5dc7d0-8e63-4eba-be4b-4b3a2568aa54 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:29.606726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fb5dc7d0-8e63-4eba-be4b-4b3a2568aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:29.632605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 989/1991] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:29.634124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcbf7f-c436-4dfa-aa8b-5e1953ff4d33 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:29.646824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcbf7f-c436-4dfa-aa8b-5e1953ff4d33 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:29.657543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:29.659307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:29.659887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:29.661044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:29.662014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:29.667218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:29.675179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:29.707768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1003/1992] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:29.713676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dc7d0-8e63-4eba-be4b-4b3a2568aa54 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:29.719885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:29.722325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:29.726947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dc7d0-8e63-4eba-be4b-4b3a2568aa54 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:29.740703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:29.741566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:29.741856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:29.742402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:29.743601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:29.747020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5f45-4026-483a-85e3-8d2229310423 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:29.748037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:29.759849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:29.760873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:29.761168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:29.761623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] PATH_INFO: `/v3/projects/331639538ae64348893b1db126e617d6` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:29.766694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=331639538ae64348893b1db126e617d6)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:29.769792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:29.894434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 990/1993] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:29 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:29.895602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:29.992194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331639538ae64348893b1db126e617d6', 'request_id': 'req-10b7f1dd-ab81-471e-946f-2b93875b7771'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:30.031031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:30.066239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81d192-4714-4aa5-8a94-d3fc7dfe59ca admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:30.096074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331639538ae64348893b1db126e617d6', 'request_id': 'req-10b7f1dd-ab81-471e-946f-2b93875b7771'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:30.120448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331639538ae64348893b1db126e617d6', 'request_id': 'req-10b7f1dd-ab81-471e-946f-2b93875b7771'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:30.161313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] The token cache is being invalidate because project 331639538ae64348893b1db126e617d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:30.164058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:30.167306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-10b7f1dd-ab81-471e-946f-2b93875b7771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:30.171681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1004/1994] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:29 2022] DELETE /identity/v3/projects/331639538ae64348893b1db126e617d6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:30.177287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ff291-d73a-44a4-8c2b-80f24ba0fe5c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.177692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ff291-d73a-44a4-8c2b-80f24ba0fe5c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.178105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ff291-d73a-44a4-8c2b-80f24ba0fe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.249715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fd0ff291-d73a-44a4-8c2b-80f24ba0fe5c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:30.255065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fd0ff291-d73a-44a4-8c2b-80f24ba0fe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:30.311235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:30.312931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.313311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.313675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.317079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:30.323953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:30.421522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1005/1995] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:30.431873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb6fc-ca59-4ab9-b652-24d258dd94f8 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.432328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb6fc-ca59-4ab9-b652-24d258dd94f8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.432700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb6fc-ca59-4ab9-b652-24d258dd94f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.447209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:30.467227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-aa1fb6fc-ca59-4ab9-b652-24d258dd94f8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:30.469649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-aa1fb6fc-ca59-4ab9-b652-24d258dd94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:30.480150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 991/1996] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:29 2022] POST /identity/v3/users => generated 287 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:30.483514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:30.485339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1006/1997] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:30.488308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:30.494757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fb6fc-ca59-4ab9-b652-24d258dd94f8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:30.504836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860edf-df73-4190-a90a-9316ab020c33 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:30.512564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fb6fc-ca59-4ab9-b652-24d258dd94f8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:30.514369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:30.514369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.514369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.514768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.517450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:30.521359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:30.525090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:30.525734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.526011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.526294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.527033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:30.527336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:30.532044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:30.550757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 992/1998] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:30.551874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:30.559461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1007/1999] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 09:57:30.563905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:30.579626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c887c6-b788-41f3-93b5-bef69c6e7377 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:30.588439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:30.589275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.589618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.590003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.590893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:30.592706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:30.593322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce1f5e-2db4-43ad-b67b-ff6a1f03cdab admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:30.610158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:30.610853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.611846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.612126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.612782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:30.614762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:30.618723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 993/2000] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:30.619881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:30.656092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf3d69-f200-457b-9fe1-cdd059bc045f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:30.676084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df147c5-420d-4a43-baf2-d017cd53f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:30.676802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df147c5-420d-4a43-baf2-d017cd53f349 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.678744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df147c5-420d-4a43-baf2-d017cd53f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.678744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df147c5-420d-4a43-baf2-d017cd53f349 admin admin] PATH_INFO: `/v3/projects/3a588e18ea624bc88930763f1d0d9cb7/users/2d8f6c4249594f10983afe1aad40c546/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.724044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df147c5-420d-4a43-baf2-d017cd53f349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a588e18ea624bc88930763f1d0d9cb7, user_id=2d8f6c4249594f10983afe1aad40c546, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:30.726859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df147c5-420d-4a43-baf2-d017cd53f349 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:30.742031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1008/2001] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:30 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:30.744051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:30.910316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 994/2002] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:30 2022] PUT /identity/v3/projects/3a588e18ea624bc88930763f1d0d9cb7/users/2d8f6c4249594f10983afe1aad40c546/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:30.922386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:30.922964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:30.924370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:30.959996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bf309-cf78-4da4-95bc-40fe1e0d9632 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:31.021882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] MFA Rules not processed for user `2d8f6c4249594f10983afe1aad40c546`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:31.025256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:31.138038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:31.140484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:31.140905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:31.141517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:31.143432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:31.148015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:31.207842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 995/2003] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:31.276366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:31.278334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:31.319203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1009/2004] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:30 2022] POST /identity/v3/users => generated 293 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:31.330228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:31.344071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb89638-593e-4582-9ece-965ea4dce458 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:31.359764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:31.360391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:31.360668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:31.360997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:31.361643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:31.367402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:31.367952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:31.402257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1010/2005] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:31.406331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:31.415273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069c006-a444-4e66-8f7c-59af98f486ab None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:31.425430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4acfe-766e-4c0d-89b4-65947b78cb64 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:31.427090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc396a1-4469-4c49-99ed-37f7862d7236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:31.427829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc396a1-4469-4c49-99ed-37f7862d7236 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:31.428333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc396a1-4469-4c49-99ed-37f7862d7236 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:31.428703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc396a1-4469-4c49-99ed-37f7862d7236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:31.446985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:31.447985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:31.448416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:31.448837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:31.449438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc396a1-4469-4c49-99ed-37f7862d7236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:31.449815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:31.451663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:31.452828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc396a1-4469-4c49-99ed-37f7862d7236 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:31.471481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1011/2006] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:31.474698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:31.482959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 996/2007] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:31.495873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a03e4-3408-426a-ada2-90d5e0ed8742 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:31.501377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:31.503012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:31.503601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:31.504026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] PATH_INFO: `/v3/projects/45f59d2fc6bf47289a65e25168bce819/users/e4d4d6c936d7429ab2acf3fec509daad/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:31.537483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f59d2fc6bf47289a65e25168bce819, user_id=e4d4d6c936d7429ab2acf3fec509daad, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:31.540773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:31.681211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1012/2008] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:31 2022] PUT /identity/v3/projects/45f59d2fc6bf47289a65e25168bce819/users/e4d4d6c936d7429ab2acf3fec509daad/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:31.693667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c774b-37e9-4e8d-8958-5e8b29f4daa1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:31.694060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c774b-37e9-4e8d-8958-5e8b29f4daa1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:31.694506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c774b-37e9-4e8d-8958-5e8b29f4daa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:31.766257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-390c774b-37e9-4e8d-8958-5e8b29f4daa1 None None] MFA Rules not processed for user `e4d4d6c936d7429ab2acf3fec509daad`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:31.768287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-390c774b-37e9-4e8d-8958-5e8b29f4daa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:31.930715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 997/2009] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:32.033669 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:32.070478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:32.148995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb7755-e732-4301-acda-d90910b75b95 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:32.179954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d4ba4-f7f2-49b1-a511-1c53a11899df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:32.180979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4ba4-f7f2-49b1-a511-1c53a11899df service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:32.181436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4ba4-f7f2-49b1-a511-1c53a11899df service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:32.181875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4ba4-f7f2-49b1-a511-1c53a11899df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:32.209001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d4ba4-f7f2-49b1-a511-1c53a11899df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:32.210858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d4ba4-f7f2-49b1-a511-1c53a11899df service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:32.253849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1013/2010] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:33.934251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c774b-37e9-4e8d-8958-5e8b29f4daa1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:34.093372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c774b-37e9-4e8d-8958-5e8b29f4daa1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:34.100775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:34.103029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:34.103458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:34.103837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] PATH_INFO: `/v3/users/e4d4d6c936d7429ab2acf3fec509daad` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:34.105424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d4d6c936d7429ab2acf3fec509daad)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:34.108699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:34.362925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d4d6c936d7429ab2acf3fec509daad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:34.431551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d4d6c936d7429ab2acf3fec509daad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:34.455239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:34.457776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d4d6c936d7429ab2acf3fec509daad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:34.458639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d4d6c936d7429ab2acf3fec509daad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:34.476877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d4d6c936d7429ab2acf3fec509daad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:34.503027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 998/2011] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:33 2022] DELETE /identity/v3/users/e4d4d6c936d7429ab2acf3fec509daad => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:34.507604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:34.508094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:34.508094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:34.576116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:34.577265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:34.661439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1014/2012] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:34.928029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:34.929551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:35.010533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d692d-adcb-4819-989a-5df6f8818491 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:35.016359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:35.017284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:35.017714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:35.018133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:35.034346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:35.036378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:35.066768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 999/2013] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:37.063573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:37.066039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:37.114536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f293c0-e069-4415-8147-84fd190ad87f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:37.127490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:37.134175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:37.134175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:37.134175 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] PATH_INFO: `/v3/projects/45f59d2fc6bf47289a65e25168bce819` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:37.135412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f59d2fc6bf47289a65e25168bce819)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:37.137417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:37.224759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:37.226206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:37.241508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4db73-4d7a-4939-976e-d92f97d84f01 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:37.248200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:37.249012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:37.249346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:37.249881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] PATH_INFO: `/v3/users/62555a9746a44dd3b31653569d1f851f` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:37.251291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62555a9746a44dd3b31653569d1f851f)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:37.253338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:37.299431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f59d2fc6bf47289a65e25168bce819', 'request_id': 'req-fd4addc9-9e94-45ce-8be9-c19880f27315'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.396615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f59d2fc6bf47289a65e25168bce819', 'request_id': 'req-fd4addc9-9e94-45ce-8be9-c19880f27315'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.403937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f59d2fc6bf47289a65e25168bce819', 'request_id': 'req-fd4addc9-9e94-45ce-8be9-c19880f27315'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.428024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] The token cache is being invalidate because project 45f59d2fc6bf47289a65e25168bce819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:37.428350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.430270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd4addc9-9e94-45ce-8be9-c19880f27315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.433264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1015/2014] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:37 2022] DELETE /identity/v3/projects/45f59d2fc6bf47289a65e25168bce819 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:37.437760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98685f-5629-4aef-abfd-df61434f1563 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:37.438321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98685f-5629-4aef-abfd-df61434f1563 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:37.439110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98685f-5629-4aef-abfd-df61434f1563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:37.481341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9f98685f-5629-4aef-abfd-df61434f1563 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:37.484227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9f98685f-5629-4aef-abfd-df61434f1563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:37.537493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62555a9746a44dd3b31653569d1f851f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.553086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:37.617635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1016/2015] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:37.618535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c83d-af6c-4b21-8729-0e48c0586454 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:37.619069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c83d-af6c-4b21-8729-0e48c0586454 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:37.620033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544c83d-af6c-4b21-8729-0e48c0586454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:37.654543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62555a9746a44dd3b31653569d1f851f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.656475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9544c83d-af6c-4b21-8729-0e48c0586454 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:37.658915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9544c83d-af6c-4b21-8729-0e48c0586454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:37.687416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1017/2016] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:37.688590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544c83d-af6c-4b21-8729-0e48c0586454 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:37.709639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544c83d-af6c-4b21-8729-0e48c0586454 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:37.709839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62555a9746a44dd3b31653569d1f851f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.710606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62555a9746a44dd3b31653569d1f851f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.715836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:37.716501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:37.716831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:37.717042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:37.717704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:37.717995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:37.721916 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:37.727592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4a9a724c-4d57-4276-87eb-b49e60474db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62555a9746a44dd3b31653569d1f851f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:37.740868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1000/2017] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:57:37 2022] DELETE /identity/v3/users/62555a9746a44dd3b31653569d1f851f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:37.744498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1018/2018] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:37.746252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:37.746252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:37.746641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:37.748654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:37.761562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:37.795990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:37.797068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ba7b9-8b2e-48f4-8f3c-3eb4bb22b9b3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:37.797487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:37.900986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:37.914624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:37.914624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:37.915329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:37.916356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:37.917170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:37.919346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:37.927492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1001/2019] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:37.940706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:37.944739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:38.030120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1019/2020] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:37 2022] POST /identity/v3/projects => generated 363 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:38.034380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:38.049772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a983e-4f71-4dc2-b211-c6c2c62219a8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:38.181977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:38.182800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:38.183093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:38.183368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:38.189665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03129c-77b0-4660-9470-ebd7583d6090 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:38.198313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:38.203786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:38.204512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:38.204959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:38.207204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:38.210166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:38.224580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:38.232631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:38.261631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1002/2021] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:38.309679 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1020/2022] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:38 2022] POST /identity/v3/users => generated 282 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:38.314236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:38.339800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279670-ea01-4157-8843-a6a6b70377e8 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:38.347609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:38.348881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:38.349370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:38.349991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:38.352826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:38.357283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:38.380462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1003/2023] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:38.384848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:38.399746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b8ba-a172-4269-8350-a1d12e5228a4 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:38.406501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bacdf-7e73-47f9-bec6-024eaa12dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:38.406501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bacdf-7e73-47f9-bec6-024eaa12dfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:38.406995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bacdf-7e73-47f9-bec6-024eaa12dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:38.407250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bacdf-7e73-47f9-bec6-024eaa12dfc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:38.408878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bacdf-7e73-47f9-bec6-024eaa12dfc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:38.410936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bacdf-7e73-47f9-bec6-024eaa12dfc0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:38.440817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1021/2024] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:38.443045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:38.461466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6120a1-988e-4e52-8f72-10414ecc6b87 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:38.468086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:38.469118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:38.473743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:38.473743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] PATH_INFO: `/v3/projects/957c4481f9b648aea145c14784aee8dc/users/edd8f385fe1c4170b92148450e17d6a3/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:38.504385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957c4481f9b648aea145c14784aee8dc, user_id=edd8f385fe1c4170b92148450e17d6a3, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:38.508822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:38.600938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1004/2025] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:38 2022] PUT /identity/v3/projects/957c4481f9b648aea145c14784aee8dc/users/edd8f385fe1c4170b92148450e17d6a3/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:38.614116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:38.614525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:38.614843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:38.672246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] MFA Rules not processed for user `edd8f385fe1c4170b92148450e17d6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:38.674927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:38.841882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1022/2026] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:38.894766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:39.002160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9ed9-ffe1-4c41-8d5f-f745b44e52d4 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:39.005713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:39.007425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc800ffe-86a6-4c6b-b436-172030a64dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:39.008142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800ffe-86a6-4c6b-b436-172030a64dfe service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:39.008543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800ffe-86a6-4c6b-b436-172030a64dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:39.008906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800ffe-86a6-4c6b-b436-172030a64dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:39.022867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc800ffe-86a6-4c6b-b436-172030a64dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:39.025265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc800ffe-86a6-4c6b-b436-172030a64dfe service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:39.039308 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1005/2027] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:39.762010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:39.764518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:39.871349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f441d0-ae16-45a4-b962-ffd1278ee281 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:39.876822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:39.878104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:39.878376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:39.878909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] PATH_INFO: `/v3/projects/4182339dba9a442e80900cdb4fcd5848` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:39.880847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4182339dba9a442e80900cdb4fcd5848)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:39.884290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:40.058150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4182339dba9a442e80900cdb4fcd5848', 'request_id': 'req-82adb315-897c-4ec8-844b-fedf75e1cc71'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:40.181241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4182339dba9a442e80900cdb4fcd5848', 'request_id': 'req-82adb315-897c-4ec8-844b-fedf75e1cc71'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:40.196137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4182339dba9a442e80900cdb4fcd5848', 'request_id': 'req-82adb315-897c-4ec8-844b-fedf75e1cc71'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:40.231582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] The token cache is being invalidate because project 4182339dba9a442e80900cdb4fcd5848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:40.234890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:40.237930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-82adb315-897c-4ec8-844b-fedf75e1cc71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:40.248256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1023/2028] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:39 2022] DELETE /identity/v3/projects/4182339dba9a442e80900cdb4fcd5848 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:40.262519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81eae-50e4-410d-b144-4c3dd4e07899 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.262519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81eae-50e4-410d-b144-4c3dd4e07899 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.262519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81eae-50e4-410d-b144-4c3dd4e07899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:40.283567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e6a81eae-50e4-410d-b144-4c3dd4e07899 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:40.284863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e6a81eae-50e4-410d-b144-4c3dd4e07899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:40.310857 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:40.360446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1006/2029] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:40.370124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade43fd-29aa-41ef-aa40-b831fa73481c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.370527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade43fd-29aa-41ef-aa40-b831fa73481c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.370917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade43fd-29aa-41ef-aa40-b831fa73481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:40.395218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-aade43fd-29aa-41ef-aa40-b831fa73481c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:40.397736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-aade43fd-29aa-41ef-aa40-b831fa73481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:40.405880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1024/2030] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:57:40.410781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81eae-50e4-410d-b144-4c3dd4e07899 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:40.427808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81eae-50e4-410d-b144-4c3dd4e07899 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:40.437076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:40.438154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.439465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.439685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:40.440808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:40.441405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:40.443533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:40.462856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1007/2031] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:40.463589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade43fd-29aa-41ef-aa40-b831fa73481c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:40.475365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade43fd-29aa-41ef-aa40-b831fa73481c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:40.480086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:40.480772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.485368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.485368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:40.485368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:40.485368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:40.571384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1025/2032] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:40 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:57:40.591509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:40.610954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e156ff-b563-4719-b7cc-0bae6d89427b admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:40.717065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:40.718128 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.718729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.719302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:40.723292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:40.731358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:40.831874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1008/2033] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:57:40 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:40.832792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:40.846139 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a997-9bf5-4271-bea4-51582ebdfe0e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:40.867763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:40.869359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.869780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.870180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:40.871034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:40.872991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:40.886083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1026/2034] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:57:40.890177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:40.915186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5920ff-ad73-4b22-9ff0-ce9aa7223fd5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:40.924854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55ca43-edeb-4c5d-b67f-aafb99ee0911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:40.925775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ca43-edeb-4c5d-b67f-aafb99ee0911 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.926399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ca43-edeb-4c5d-b67f-aafb99ee0911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.927433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55ca43-edeb-4c5d-b67f-aafb99ee0911 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:40.928354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55ca43-edeb-4c5d-b67f-aafb99ee0911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:40.935793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55ca43-edeb-4c5d-b67f-aafb99ee0911 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:40.966218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:40.966543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1009/2035] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:57:40.977387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:40.981867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480f716-c1a8-4f7c-b773-bcbe3a0142ae admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:40.987781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:40.991964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:40.991964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:40.991964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] PATH_INFO: `/v3/projects/4eb277bbeacf469cb2361666497d1fe1/users/50bb054e9304439e9d24e4a0b3baa471/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:41.026309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb277bbeacf469cb2361666497d1fe1, user_id=50bb054e9304439e9d24e4a0b3baa471, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:41.029456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:41.258656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1027/2036] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:57:40 2022] PUT /identity/v3/projects/4eb277bbeacf469cb2361666497d1fe1/users/50bb054e9304439e9d24e4a0b3baa471/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:57:41.272773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:41.273353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:41.273353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:41.328126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] MFA Rules not processed for user `50bb054e9304439e9d24e4a0b3baa471`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:57:41.330077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:41.463133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1010/2037] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:57:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:57:41.524448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:41.526205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:41.670927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07471d4-c143-49c8-a87a-4934e79ff20c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:41.699059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:41.701264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:41.701264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:41.701264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:41.712443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:41.714466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:41.727470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1028/2038] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:45.929910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:45.931796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:45.962312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:46.112065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61ce11-13f0-4687-99e5-5db4003991f2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:46.118933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b7252d86d745fbbe75f8973a570932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40109cf8c9445bd9177053c230110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:46.119715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:46.120108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:46.120529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:46.121363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:46.121775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:46.123685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:46.149434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1011/2039] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:46.150122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:46.175796 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5678bfc-33b3-425f-b21d-9bb7503446a4 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:46.182389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b7252d86d745fbbe75f8973a570932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40109cf8c9445bd9177053c230110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:46.183289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:46.183961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:46.184479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:46.185502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:46.190315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:46.366960 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:46.367923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1029/2040] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:57:46 2022] POST /identity/v3/projects => generated 348 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:57:46.382732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c9f7e-81e7-4a58-98b4-ac0f672d5c7a tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:46.492229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b7252d86d745fbbe75f8973a570932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40109cf8c9445bd9177053c230110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:46.492868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:46.493274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:46.493402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:46.494075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:57:46.494385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:46.496187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:46.512398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1012/2041] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:57:48.637900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:48.649159 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658cef-1f15-4223-9664-4dd064d0febc tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:48.654370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b7252d86d745fbbe75f8973a570932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b40109cf8c9445bd9177053c230110ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:48.655257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:48.655709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:48.656146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] PATH_INFO: `/v3/projects/b34052f3ca744da9b2f248af9bbdbb52` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:48.657517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b34052f3ca744da9b2f248af9bbdbb52)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:48.659703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:48.813135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34052f3ca744da9b2f248af9bbdbb52', 'request_id': 'req-0b0a4602-64d6-42a3-828b-b1a4176e2a32'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:48.878720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34052f3ca744da9b2f248af9bbdbb52', 'request_id': 'req-0b0a4602-64d6-42a3-828b-b1a4176e2a32'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:48.885704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34052f3ca744da9b2f248af9bbdbb52', 'request_id': 'req-0b0a4602-64d6-42a3-828b-b1a4176e2a32'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:48.904081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] The token cache is being invalidate because project b34052f3ca744da9b2f248af9bbdbb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:57:48.904734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:48.905660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:57:48.909049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1030/2042] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:48 2022] DELETE /identity/v3/projects/b34052f3ca744da9b2f248af9bbdbb52 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:57:48.931778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:57:48.933700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:49.052053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ffee9-ad42-4ecb-ae31-410f88e13170 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:57:49.177497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345d9e1-9ed5-457a-afed-bc6312f68d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:57:49.179040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d9e1-9ed5-457a-afed-bc6312f68d64 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:57:49.179611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d9e1-9ed5-457a-afed-bc6312f68d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:57:49.183667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d9e1-9ed5-457a-afed-bc6312f68d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:57:49.194163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4345d9e1-9ed5-457a-afed-bc6312f68d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:57:49.238589 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:49.316622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345d9e1-9ed5-457a-afed-bc6312f68d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:57:49.323591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345d9e1-9ed5-457a-afed-bc6312f68d64 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:57:49.345395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1013/2043] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:57:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:57:58.899954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=70,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:59.564449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=18 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:04.624915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:04.628063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:04.776944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a4602-64d6-42a3-828b-b1a4176e2a32 tempest-RoutersAdminTest-446108438 tempest-RoutersAdminTest-446108438-project-admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:04.782880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:04.783920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:04.784436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:04.784922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] PATH_INFO: `/v3/users/2d8f6c4249594f10983afe1aad40c546` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:04.786401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8f6c4249594f10983afe1aad40c546)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:04.789950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:05.061774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8f6c4249594f10983afe1aad40c546'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:05.171191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8f6c4249594f10983afe1aad40c546'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:05.171832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8f6c4249594f10983afe1aad40c546'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:05.188685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8f6c4249594f10983afe1aad40c546'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:05.212162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8f6c4249594f10983afe1aad40c546'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:05.226640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1031/2044] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:04 2022] DELETE /identity/v3/users/2d8f6c4249594f10983afe1aad40c546 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:05.238589 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:05.239165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:05.239165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:05.277923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:05.279568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:05.445916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1014/2045] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:05.471377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:05.473298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:05.622563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436619-fd8b-44a4-b647-5114d702bbf6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:05.627524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ea260-7f10-4c4f-8f8a-7be5c5f99056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:05.628231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ea260-7f10-4c4f-8f8a-7be5c5f99056 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:05.628653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ea260-7f10-4c4f-8f8a-7be5c5f99056 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:05.629031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ea260-7f10-4c4f-8f8a-7be5c5f99056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:05.641471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ea260-7f10-4c4f-8f8a-7be5c5f99056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:05.644256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ea260-7f10-4c4f-8f8a-7be5c5f99056 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:05.659491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1032/2046] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:07.061107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:07.064447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:07.089448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770797b7-f01c-4196-8815-b31a6c09eeb1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:07.097864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:07.103952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:07.103952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:07.103952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] PATH_INFO: `/v3/projects/3a588e18ea624bc88930763f1d0d9cb7` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:07.103952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a588e18ea624bc88930763f1d0d9cb7)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:07.106492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:07.352228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a588e18ea624bc88930763f1d0d9cb7', 'request_id': 'req-679eb705-fed3-439e-a873-a7035f2ed9b3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:07.472440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a588e18ea624bc88930763f1d0d9cb7', 'request_id': 'req-679eb705-fed3-439e-a873-a7035f2ed9b3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:07.479384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a588e18ea624bc88930763f1d0d9cb7', 'request_id': 'req-679eb705-fed3-439e-a873-a7035f2ed9b3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:07.503177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] The token cache is being invalidate because project 3a588e18ea624bc88930763f1d0d9cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:07.503474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:07.508097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-679eb705-fed3-439e-a873-a7035f2ed9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:07.510164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1015/2047] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:07 2022] DELETE /identity/v3/projects/3a588e18ea624bc88930763f1d0d9cb7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:07.516057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85240-173a-4422-8b2f-9a88a7d005d4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:07.517185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85240-173a-4422-8b2f-9a88a7d005d4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:07.517857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85240-173a-4422-8b2f-9a88a7d005d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:07.559835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ccf85240-173a-4422-8b2f-9a88a7d005d4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:07.562376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ccf85240-173a-4422-8b2f-9a88a7d005d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:07.605648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:07.705776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1033/2048] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:07.711748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5f34-a6b1-40a5-90a5-a27019f9e59e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:07.712099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5f34-a6b1-40a5-90a5-a27019f9e59e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:07.712372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5f34-a6b1-40a5-90a5-a27019f9e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:07.752095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cb4e5f34-a6b1-40a5-90a5-a27019f9e59e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:07.756381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cb4e5f34-a6b1-40a5-90a5-a27019f9e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:07.780383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1016/2049] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:07.784672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85240-173a-4422-8b2f-9a88a7d005d4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:07.797523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85240-173a-4422-8b2f-9a88a7d005d4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:07.817019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:07.819073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:07.819073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:07.819073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:07.819073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:58:07.819548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:07.821006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:07.843882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1034/2050] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:58:07.861876 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5f34-a6b1-40a5-90a5-a27019f9e59e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:07.874250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5f34-a6b1-40a5-90a5-a27019f9e59e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:07.887364 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:07.888016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:07.888299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:07.888575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:07.889245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:07.903554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:08.026064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1017/2051] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:58:07 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:08.031614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:08.048109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a040-5f7a-4a85-8f29-8f023c22fce2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:08.167010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:08.167686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.168029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.168289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.168950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:08.175521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:08.330128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1035/2052] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:58:08 2022] POST /identity/v3/users => generated 285 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:08.335059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:08.348859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e718acd-f84f-451f-8b15-07aa9548da48 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:08.353957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:08.354597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.354957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.355234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.356281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:08.375925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:08.398934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:08.412039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12ac7e-aea2-452f-8f4d-2c8f0a8b6526 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:08.414329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1018/2053] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:08.422191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082ceff-16b8-4c11-bcaf-589322c0e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:08.423857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ceff-16b8-4c11-bcaf-589322c0e312 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.436117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ceff-16b8-4c11-bcaf-589322c0e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.438245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ceff-16b8-4c11-bcaf-589322c0e312 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.439487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082ceff-16b8-4c11-bcaf-589322c0e312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:08.444219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082ceff-16b8-4c11-bcaf-589322c0e312 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:08.464879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:08.471150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1036/2054] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:08.478450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad4c63-8b45-4c33-a4ed-f39fb8760ee1 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:08.484484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:08.486200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.486706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.487192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] PATH_INFO: `/v3/projects/f0a2e694ad734b67b2fe5e3b8b1efc8b/users/5bfef6460caf4de99f6dc1fe054307a4/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.508532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a2e694ad734b67b2fe5e3b8b1efc8b, user_id=5bfef6460caf4de99f6dc1fe054307a4, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:08.511772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:08.607578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1019/2055] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:58:08 2022] PUT /identity/v3/projects/f0a2e694ad734b67b2fe5e3b8b1efc8b/users/5bfef6460caf4de99f6dc1fe054307a4/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:08.619756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:08.621367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:08.622093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:08.711824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] MFA Rules not processed for user `5bfef6460caf4de99f6dc1fe054307a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:08.713981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:08.827481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1037/2056] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:08.862701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:08.864779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:08.914515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:09.013041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39304be-0f3a-4fd7-a0d8-230226d11037 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:09.019739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f7808-a783-4ae2-88fe-a3af443c7050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:09.023058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f7808-a783-4ae2-88fe-a3af443c7050 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:09.023058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f7808-a783-4ae2-88fe-a3af443c7050 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:09.023058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f7808-a783-4ae2-88fe-a3af443c7050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:09.040576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f7808-a783-4ae2-88fe-a3af443c7050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:09.044313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f7808-a783-4ae2-88fe-a3af443c7050 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:09.062430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1020/2057] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:18.821395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:20.620968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=17 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:25.299442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:25.306124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:25.554780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42c797-544c-4122-8dfe-2d6d9f2f6db4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:25.573535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:25.574518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:25.575039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:25.575463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] PATH_INFO: `/v3/users/50bb054e9304439e9d24e4a0b3baa471` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:25.576879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bb054e9304439e9d24e4a0b3baa471)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:25.578999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:25.818219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bb054e9304439e9d24e4a0b3baa471'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:25.891932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bb054e9304439e9d24e4a0b3baa471'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:25.892592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bb054e9304439e9d24e4a0b3baa471'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:25.909387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bb054e9304439e9d24e4a0b3baa471'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:25.947990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bb054e9304439e9d24e4a0b3baa471'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:25.961876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1038/2058] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:58:25 2022] DELETE /identity/v3/users/50bb054e9304439e9d24e4a0b3baa471 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:25.968117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:25.969727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:25.970975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:26.011414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:26.012658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:26.219109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1021/2059] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:26.257851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:26.257851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:26.413350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c271555-a2f7-4cb5-a685-f2e44fbcfd47 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:26.418110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66cd6c-0633-463d-9b58-bbcc0d3386ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:26.419371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66cd6c-0633-463d-9b58-bbcc0d3386ad service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:26.420031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66cd6c-0633-463d-9b58-bbcc0d3386ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:26.420500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66cd6c-0633-463d-9b58-bbcc0d3386ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:26.433927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66cd6c-0633-463d-9b58-bbcc0d3386ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:26.435905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66cd6c-0633-463d-9b58-bbcc0d3386ad service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:26.468234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1039/2060] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:28.373467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:28.376180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:28.410705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86963acb-c401-421f-a461-791bbd5485f6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:28.428592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:28.429259 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.430313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.430313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] PATH_INFO: `/v3/projects/4eb277bbeacf469cb2361666497d1fe1` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.431025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb277bbeacf469cb2361666497d1fe1)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:28.433032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:28.574541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb277bbeacf469cb2361666497d1fe1', 'request_id': 'req-627de07b-eaae-4f53-94f4-779305ed7b9f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.682455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb277bbeacf469cb2361666497d1fe1', 'request_id': 'req-627de07b-eaae-4f53-94f4-779305ed7b9f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.687057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb277bbeacf469cb2361666497d1fe1', 'request_id': 'req-627de07b-eaae-4f53-94f4-779305ed7b9f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.721626 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] The token cache is being invalidate because project 4eb277bbeacf469cb2361666497d1fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:58:28.728814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.728814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-627de07b-eaae-4f53-94f4-779305ed7b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:58:28.729257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1022/2061] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:58:28 2022] DELETE /identity/v3/projects/4eb277bbeacf469cb2361666497d1fe1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:28.730464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195228d-2d02-470d-91a7-f0dc3469ac45 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.730998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195228d-2d02-470d-91a7-f0dc3469ac45 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.731101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195228d-2d02-470d-91a7-f0dc3469ac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.775519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b195228d-2d02-470d-91a7-f0dc3469ac45 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:28.779803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b195228d-2d02-470d-91a7-f0dc3469ac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:28.829203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:28.939468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1040/2062] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:58:28.946914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f621-a5f0-4253-b8ff-d6f8a30521ab None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:28.947500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f621-a5f0-4253-b8ff-d6f8a30521ab None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:28.947856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622f621-a5f0-4253-b8ff-d6f8a30521ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:28.992150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-2622f621-a5f0-4253-b8ff-d6f8a30521ab None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:28.993908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2622f621-a5f0-4253-b8ff-d6f8a30521ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:29.016997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1023/2063] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:29.021931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195228d-2d02-470d-91a7-f0dc3469ac45 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:29.042767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195228d-2d02-470d-91a7-f0dc3469ac45 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.056593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.057788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.058517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.059124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.060791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:58:29.061458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.065493 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:29.099185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1041/2064] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:58:29.104251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622f621-a5f0-4253-b8ff-d6f8a30521ab None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:29.125087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622f621-a5f0-4253-b8ff-d6f8a30521ab None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.157945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.162924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.163208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.163480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.164210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.166472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:29.347150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1024/2065] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:58:29 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:29.351049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:29.375974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e7615-64f7-4387-a6eb-63b91300e966 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.508293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.509406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.509512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.509948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.510691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.520090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:29.703104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1042/2066] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:58:29 2022] POST /identity/v3/users => generated 290 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:58:29.712355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:29.728461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b360a92-2e30-4841-b2e2-7ae86bb16f39 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.742113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.743416 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.749757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.751042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.752760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.756410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:29.786279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1025/2067] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:29.787314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:29.813212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988b294-06d2-4c4b-a0df-727507ec454e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.826486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206d489-decc-4853-bc31-bce2fde532bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.827367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d489-decc-4853-bc31-bce2fde532bd admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.827794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d489-decc-4853-bc31-bce2fde532bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.829177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206d489-decc-4853-bc31-bce2fde532bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.830600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206d489-decc-4853-bc31-bce2fde532bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.832453 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206d489-decc-4853-bc31-bce2fde532bd admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:29.863621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1043/2068] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:58:29.868615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:29.890972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa6929-f531-4927-a6f8-80779ff8fee2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:29.903273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:29.904321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:29.912225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:29.912225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] PATH_INFO: `/v3/projects/5116179308ad48c498743b76d81ab491/users/93c69a6005604cef9e763b5831323198/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:29.934727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5116179308ad48c498743b76d81ab491, user_id=93c69a6005604cef9e763b5831323198, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:29.939731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:30.049780 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1026/2069] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:58:29 2022] PUT /identity/v3/projects/5116179308ad48c498743b76d81ab491/users/93c69a6005604cef9e763b5831323198/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:58:30.063710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:30.064536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:30.064803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:30.131393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] MFA Rules not processed for user `93c69a6005604cef9e763b5831323198`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:58:30.132946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:30.287388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1044/2070] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:58:30.379107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:30.379107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:30.437856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:30.526637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc73283-2d01-4538-b6e1-709bbc125280 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:30.533790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:30.534542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:30.534860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:30.535329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:30.547509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:30.549573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:30.562508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1027/2071] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:58:40.283028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:42.222905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=17 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:54.635682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:58:54.639335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:54.799910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47edfb-4ec5-49ab-8cac-0240a01c023c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:58:54.810812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:58:54.812073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:58:54.812460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:58:54.812874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:58:54.821373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:58:54.858089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:58:54.866393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:58:54.885338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1045/2072] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:58:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:04.877441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=32 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:12.678054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:12.684339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:12.873998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68fcad-e943-42c1-bc90-07736ef7614d service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:12.879600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:12.880445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:12.882289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:12.883083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] PATH_INFO: `/v3/users/61905bcad03541acb0a06f57b1c55795` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:12.884503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61905bcad03541acb0a06f57b1c55795)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:12.886663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:13.120552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61905bcad03541acb0a06f57b1c55795'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:13.220085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61905bcad03541acb0a06f57b1c55795'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:13.271045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61905bcad03541acb0a06f57b1c55795'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:13.271990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61905bcad03541acb0a06f57b1c55795'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:13.382925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab6b8c2c-2c6a-499f-bdbc-29746e52213e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61905bcad03541acb0a06f57b1c55795'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:13.443297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1028/2073] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:12 2022] DELETE /identity/v3/users/61905bcad03541acb0a06f57b1c55795 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:15.664352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:15.692030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f80bda-8136-49ce-af5d-75c8e0146594 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:15.807421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:15.808312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:15.809576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:15.810008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] PATH_INFO: `/v3/projects/1c1772cbf744449891cae928448c57eb` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:15.814141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1772cbf744449891cae928448c57eb)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:15.817160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:15.970374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1772cbf744449891cae928448c57eb', 'request_id': 'req-5b773008-cdf2-4090-8cfc-a4a444b0b267'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.043318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1772cbf744449891cae928448c57eb', 'request_id': 'req-5b773008-cdf2-4090-8cfc-a4a444b0b267'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.052927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1772cbf744449891cae928448c57eb', 'request_id': 'req-5b773008-cdf2-4090-8cfc-a4a444b0b267'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.093558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] The token cache is being invalidate because project 1c1772cbf744449891cae928448c57eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:16.093806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.095075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5b773008-cdf2-4090-8cfc-a4a444b0b267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:16.101539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1046/2074] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:15 2022] DELETE /identity/v3/projects/1c1772cbf744449891cae928448c57eb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:16.105509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481787-5b65-4980-a077-a101684b2eff None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.106389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481787-5b65-4980-a077-a101684b2eff None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.106874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481787-5b65-4980-a077-a101684b2eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.164875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-d8481787-5b65-4980-a077-a101684b2eff None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:16.168037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d8481787-5b65-4980-a077-a101684b2eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:16.375254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1029/2075] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:16.377419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dae0c-5672-49bf-b342-b49332850108 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.377707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dae0c-5672-49bf-b342-b49332850108 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.377980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dae0c-5672-49bf-b342-b49332850108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.410840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-673dae0c-5672-49bf-b342-b49332850108 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:16.414567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-673dae0c-5672-49bf-b342-b49332850108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:16.442929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1047/2076] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:16.444068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8481787-5b65-4980-a077-a101684b2eff None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:16.462757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8481787-5b65-4980-a077-a101684b2eff None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:16.469651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:16.470283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.475232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.475232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.475232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:16.475232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:16.475232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:16.496971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1030/2077] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:16.498773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dae0c-5672-49bf-b342-b49332850108 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:16.517753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dae0c-5672-49bf-b342-b49332850108 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:16.524936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:16.526606 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.527252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.527538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.528195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:16.530539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:16.687822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1048/2078] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:16 2022] POST /identity/v3/projects => generated 399 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:16.693482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:16.714957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c66ca-0fd3-4dbd-810d-e7c5f92fd3ec admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:16.724091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:16.849243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:16.849871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:16.850148 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:16.850457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:16.851208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:16.853170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:17.004591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1031/2079] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:16 2022] POST /identity/v3/users => generated 300 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:17.017756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:17.031047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77eeb-d9ca-4f9a-be6d-790c34432fb2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:17.036128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:17.037384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:17.038292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:17.038629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:17.039475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:17.041218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:17.055847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1049/2080] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:17.059767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:17.074739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5e134-8852-4e08-901d-09947676b043 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:17.083423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798caa09-72f6-40c2-b6ea-5b2c2ece284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:17.084208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798caa09-72f6-40c2-b6ea-5b2c2ece284c admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:17.084595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798caa09-72f6-40c2-b6ea-5b2c2ece284c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:17.084940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798caa09-72f6-40c2-b6ea-5b2c2ece284c admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:17.085768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798caa09-72f6-40c2-b6ea-5b2c2ece284c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:17.089681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798caa09-72f6-40c2-b6ea-5b2c2ece284c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:17.119230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1032/2081] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 09:59:17.121514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:17.137878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f55daa-bbcf-4077-aef0-61f422e52422 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:17.145403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:17.146457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:17.147188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:17.147908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] PATH_INFO: `/v3/projects/abb615b8ad924198b6603af289d65e34/users/fa4e9b7c4dbf4f9197c089fad453244f/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:17.204013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb615b8ad924198b6603af289d65e34, user_id=fa4e9b7c4dbf4f9197c089fad453244f, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:17.208667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:17.349719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1050/2082] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:17 2022] PUT /identity/v3/projects/abb615b8ad924198b6603af289d65e34/users/fa4e9b7c4dbf4f9197c089fad453244f/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:17.349867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caccde-3cf6-4358-adcd-6e8bf532f2e4 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:17.350136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caccde-3cf6-4358-adcd-6e8bf532f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:17.350404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2caccde-3cf6-4358-adcd-6e8bf532f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:17.412847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b2caccde-3cf6-4358-adcd-6e8bf532f2e4 None None] MFA Rules not processed for user `fa4e9b7c4dbf4f9197c089fad453244f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:17.414036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b2caccde-3cf6-4358-adcd-6e8bf532f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:17.527709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1033/2083] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:17.532163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:17.593825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:17.650003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff574ee-7e67-40d2-a8ae-e8ebd38bc87d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:17.661396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:17.662568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:17.663166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:17.663653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:17.664596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:17.669876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:17.785989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1051/2084] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:17 2022] POST /identity/v3/projects => generated 395 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:17.792600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caccde-3cf6-4358-adcd-6e8bf532f2e4 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:17.843597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2caccde-3cf6-4358-adcd-6e8bf532f2e4 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:17.999056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:18.001888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:18.005741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:18.006254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:18.008333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:18.012698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:18.144275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1034/2085] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:17 2022] POST /identity/v3/users => generated 304 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:18.147367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:18.173586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fd541-ba0e-4d9a-a56e-82a0b83d7656 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:18.192482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:18.193275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:18.193560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:18.193828 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:18.194482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:18.212597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:18.249832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1052/2086] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:18.257233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:18.281302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:18.303663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2fbe6-979a-43d0-8783-dd83e85edf6e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:18.312406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:18.316357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:18.319723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:18.319723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] PATH_INFO: `/v3/projects/3cafc17f01f94eb8b1eba4ae92ced742/users/45d81840be8243a380ee4ef9ee516347/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:18.373560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cafc17f01f94eb8b1eba4ae92ced742, user_id=45d81840be8243a380ee4ef9ee516347, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:18.379973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:18.473288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1035/2087] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:18 2022] PUT /identity/v3/projects/3cafc17f01f94eb8b1eba4ae92ced742/users/45d81840be8243a380ee4ef9ee516347/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:18.477039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:18.512171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bf97c-4efb-4ce4-99f3-986b273f35f7 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:18.632980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744946ca-0008-4bd6-ac4f-6044520bc8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:18.634520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744946ca-0008-4bd6-ac4f-6044520bc8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:18.635197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744946ca-0008-4bd6-ac4f-6044520bc8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:18.635632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744946ca-0008-4bd6-ac4f-6044520bc8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:18.636470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744946ca-0008-4bd6-ac4f-6044520bc8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:18.638866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744946ca-0008-4bd6-ac4f-6044520bc8a4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:18.663178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1053/2088] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:18.664787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:18.702322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bdc0f-2a84-4bd6-85bd-976a72f79b14 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:18.710040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:18.711026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:18.711411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:18.711787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] PATH_INFO: `/v3/projects/3cafc17f01f94eb8b1eba4ae92ced742/users/45d81840be8243a380ee4ef9ee516347/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:18.714387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cafc17f01f94eb8b1eba4ae92ced742, user_id=45d81840be8243a380ee4ef9ee516347, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:18.720390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:18.735425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1036/2089] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:18 2022] PUT /identity/v3/projects/3cafc17f01f94eb8b1eba4ae92ced742/users/45d81840be8243a380ee4ef9ee516347/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:18.749480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:18.749605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:18.749768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:18.791933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] MFA Rules not processed for user `45d81840be8243a380ee4ef9ee516347`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:18.793991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:18.916812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1054/2090] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:18.995409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:18.997007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:19.102972 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044a0c2-cee5-4791-b364-ea83b10d045a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:19.108068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:19.108867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:19.109290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:19.109672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:19.186132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:19.187901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:19.200692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1037/2091] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:21.277701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:21.279409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:21.318972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:21.458101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977475-3a78-429a-a568-85cd17e0414a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:21.484658 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25356-3215-4ceb-9d25-5d9bb45d7d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:21.485417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25356-3215-4ceb-9d25-5d9bb45d7d68 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:21.485698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25356-3215-4ceb-9d25-5d9bb45d7d68 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:21.486222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25356-3215-4ceb-9d25-5d9bb45d7d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:21.504457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25356-3215-4ceb-9d25-5d9bb45d7d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:21.506135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25356-3215-4ceb-9d25-5d9bb45d7d68 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:21.550928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1055/2092] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:21 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:26.912176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:26.914064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:27.059340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1a34-f6af-45f2-b98d-018f1ad3ac4a service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:27.075706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:27.076764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:27.077230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:27.077652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] PATH_INFO: `/v3/users/93c69a6005604cef9e763b5831323198` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:27.079094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c69a6005604cef9e763b5831323198)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:27.081821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:27.137159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:27.513511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c69a6005604cef9e763b5831323198'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:27.614873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c69a6005604cef9e763b5831323198'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:27.641170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c69a6005604cef9e763b5831323198'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:27.644652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c69a6005604cef9e763b5831323198'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:27.666291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c69a6005604cef9e763b5831323198'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:27.696636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:27.697407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1038/2093] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:26 2022] DELETE /identity/v3/users/93c69a6005604cef9e763b5831323198 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:27.697715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:27.697987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:27.751903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:27.753214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:27.897739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1056/2094] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:27.928214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:27.930985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:28.052263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8320b-9330-45a2-88d7-05191132f63d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:28.062874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6ce5d-54bc-401c-806b-9dabf74a3be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:28.063503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ce5d-54bc-401c-806b-9dabf74a3be4 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:28.063782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ce5d-54bc-401c-806b-9dabf74a3be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:28.064047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ce5d-54bc-401c-806b-9dabf74a3be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:28.085977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:28.090924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:28.098298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6ce5d-54bc-401c-806b-9dabf74a3be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:28.099846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6ce5d-54bc-401c-806b-9dabf74a3be4 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:28.107462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d2a08-7a7f-4dfb-afad-cc53afbc1724 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:28.118753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:28.119521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:28.119800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:28.120070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] PATH_INFO: `/v3/users/aa495841913747d098c6a0f8628bd757` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:28.121799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1039/2095] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:28.122470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa495841913747d098c6a0f8628bd757)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:28.124717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:28.319491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa495841913747d098c6a0f8628bd757'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:28.421472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa495841913747d098c6a0f8628bd757'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:28.439858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa495841913747d098c6a0f8628bd757'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:28.462661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa495841913747d098c6a0f8628bd757'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:28.478276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa495841913747d098c6a0f8628bd757'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:28.487946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1057/2096] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:28 2022] DELETE /identity/v3/users/aa495841913747d098c6a0f8628bd757 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:28.492404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:28.493048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:28.493603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:28.524574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:28.529147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:28.530534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:28.532245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:28.578398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:28.651825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569da33-c2b2-4fa1-a053-0c85affe7186 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:28.657664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:28.658338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:28.658621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:28.660060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] PATH_INFO: `/v3/projects/5116179308ad48c498743b76d81ab491` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:28.661229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5116179308ad48c498743b76d81ab491)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:28.663408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:28.673885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1040/2097] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:28.687005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:28.690499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:28.786118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:28.801116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316cc3-09e1-40fb-add5-f0d7441dd3b6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:28.805036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7784d2-92e4-4e3b-8830-796d1de310cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:28.808401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7784d2-92e4-4e3b-8830-796d1de310cc service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:28.808401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7784d2-92e4-4e3b-8830-796d1de310cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:28.808401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7784d2-92e4-4e3b-8830-796d1de310cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:28.817228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7784d2-92e4-4e3b-8830-796d1de310cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:28.818702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7784d2-92e4-4e3b-8830-796d1de310cc service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:28.838819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1041/2098] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:59:28.932977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5116179308ad48c498743b76d81ab491', 'request_id': 'req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:29.006198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5116179308ad48c498743b76d81ab491', 'request_id': 'req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:29.032525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5116179308ad48c498743b76d81ab491', 'request_id': 'req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:29.071483 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] The token cache is being invalidate because project 5116179308ad48c498743b76d81ab491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:29.073165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:29.074513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7c4d57b7-bb74-4602-ac8c-dee4f8a1524b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:29.080434 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1058/2099] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:28 2022] DELETE /identity/v3/projects/5116179308ad48c498743b76d81ab491 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:29.081715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f4c1-9be5-458b-b26a-0ee448c8d230 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:29.082162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f4c1-9be5-458b-b26a-0ee448c8d230 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:29.082326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f4c1-9be5-458b-b26a-0ee448c8d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:29.123706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0c93f4c1-9be5-458b-b26a-0ee448c8d230 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:29.126925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0c93f4c1-9be5-458b-b26a-0ee448c8d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:29.283633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1042/2100] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:29.303239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181ad68-9030-4170-b35a-9ebe94025721 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:29.305410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181ad68-9030-4170-b35a-9ebe94025721 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:29.305410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181ad68-9030-4170-b35a-9ebe94025721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:29.336555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3181ad68-9030-4170-b35a-9ebe94025721 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:29.338502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3181ad68-9030-4170-b35a-9ebe94025721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:29.364016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1059/2101] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:29.370304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93f4c1-9be5-458b-b26a-0ee448c8d230 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:29.389812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93f4c1-9be5-458b-b26a-0ee448c8d230 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:29.399481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:29.400946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:29.401392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:29.401975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:29.403230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:29.403710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:29.405863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:29.430914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1043/2102] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:29.431711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181ad68-9030-4170-b35a-9ebe94025721 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:29.442758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181ad68-9030-4170-b35a-9ebe94025721 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:29.452000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:29.453211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:29.453660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:29.454072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:29.454966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:29.457675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:29.566960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1060/2103] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:29 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:29.572728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:29.584889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae772e62-b5c2-4a18-b073-ce7da281f535 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:29.707612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:29.708288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:29.708712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:29.709276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:29.709931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:29.711973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:29.849074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1044/2104] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:29 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:29.850009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:29.886537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90397ea-722c-4b44-88f9-221bfd686fe5 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:29.908145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:29.909623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:29.910288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:29.910567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:29.911271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:29.912929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:29.937107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1061/2105] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:29.940361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:29.952529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620cb00-ea6e-4d72-821f-b61b876de473 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:29.959301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351f59e-305f-49a5-beb7-060c26292334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:29.960206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351f59e-305f-49a5-beb7-060c26292334 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:29.960678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351f59e-305f-49a5-beb7-060c26292334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:29.961256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351f59e-305f-49a5-beb7-060c26292334 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:29.962105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351f59e-305f-49a5-beb7-060c26292334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:29.964116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351f59e-305f-49a5-beb7-060c26292334 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:29.979661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1045/2106] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:29.984204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:29.997473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74124746-855a-48b5-aacf-3efc0f861873 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:30.014532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:30.015690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:30.016708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:30.018893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] PATH_INFO: `/v3/projects/86f29fb9cf294d99afd22508d93db94e/users/6da7b20d503d40e6879e7678022696ad/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:30.076757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f29fb9cf294d99afd22508d93db94e, user_id=6da7b20d503d40e6879e7678022696ad, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:30.080293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:30.239923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1062/2107] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:29 2022] PUT /identity/v3/projects/86f29fb9cf294d99afd22508d93db94e/users/6da7b20d503d40e6879e7678022696ad/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 09:59:30.253596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df849-659c-411b-8150-6361bede5807 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:30.254112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df849-659c-411b-8150-6361bede5807 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:30.254403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df849-659c-411b-8150-6361bede5807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:30.256467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:30.262810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:30.390719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1f4df849-659c-411b-8150-6361bede5807 None None] MFA Rules not processed for user `6da7b20d503d40e6879e7678022696ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:30.391984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1f4df849-659c-411b-8150-6361bede5807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:30.448089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:30.490609 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:30.493373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea48f0-5715-4594-a123-0a4963502335 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:30.511326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:30.512486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:30.512972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:30.513445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] PATH_INFO: `/v3/projects/89cfc5b3f25c4c4690ddbdba676c129f` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:30.516676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cfc5b3f25c4c4690ddbdba676c129f)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:30.521140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:30.556582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1046/2108] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:30.617507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4df849-659c-411b-8150-6361bede5807 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:30.620149 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1f4df849-659c-411b-8150-6361bede5807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:30.712642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cfc5b3f25c4c4690ddbdba676c129f', 'request_id': 'req-16455837-617c-40e7-8b47-50847b0cecf3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:30.788426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4df849-659c-411b-8150-6361bede5807 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:30.812640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cfc5b3f25c4c4690ddbdba676c129f', 'request_id': 'req-16455837-617c-40e7-8b47-50847b0cecf3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:30.830209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cfc5b3f25c4c4690ddbdba676c129f', 'request_id': 'req-16455837-617c-40e7-8b47-50847b0cecf3'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:30.884795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] The token cache is being invalidate because project 89cfc5b3f25c4c4690ddbdba676c129f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:30.887960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:30.903172 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-16455837-617c-40e7-8b47-50847b0cecf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:30.909839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1063/2109] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:30 2022] DELETE /identity/v3/projects/89cfc5b3f25c4c4690ddbdba676c129f => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:30.916335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498d49-1e83-498b-9b69-e832711ef0da None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:30.916848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498d49-1e83-498b-9b69-e832711ef0da None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:30.917818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498d49-1e83-498b-9b69-e832711ef0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:30.975962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c0498d49-1e83-498b-9b69-e832711ef0da None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:30.977251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c0498d49-1e83-498b-9b69-e832711ef0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:31.001009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:31.003393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.003671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.003941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.009966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:31.148459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1064/2110] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:31.158301 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0389a-5cfa-43bb-b102-ca2f59afe154 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.159449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0389a-5cfa-43bb-b102-ca2f59afe154 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.160232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0389a-5cfa-43bb-b102-ca2f59afe154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.180070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:31.183104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:31.196672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0bf0389a-5cfa-43bb-b102-ca2f59afe154 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:31.198337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0bf0389a-5cfa-43bb-b102-ca2f59afe154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:31.201997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1047/2111] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:59:31.209113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1065/2112] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:31.214944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:31.230660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be494eea-2630-4c9d-b7ac-1b6cf6653da8 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:31.240201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:31.240201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.240201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.240201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.240685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:31.240685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:31.241274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:31.260659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0389a-5cfa-43bb-b102-ca2f59afe154 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:31.268911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1048/2113] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:31.272332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0389a-5cfa-43bb-b102-ca2f59afe154 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:31.278174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:31.278992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.280023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.282684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:31.285570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:31.288813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.293581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:31.298447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:31.314627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f7c3c-b270-4e1a-92bc-12fe863afa37 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:31.333132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:31.335283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.335421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.337286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] PATH_INFO: `/v3/users/6da7b20d503d40e6879e7678022696ad` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.342201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da7b20d503d40e6879e7678022696ad)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:31.347858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:31.452754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1066/2114] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:31 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:31.457812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:31.610423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:31.614997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5943863-928b-4208-9f0b-43dee54570c2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:31.619346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:31.619976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.620252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.620520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.621154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:31.623288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:31.635167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da7b20d503d40e6879e7678022696ad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:31.749978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da7b20d503d40e6879e7678022696ad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:31.763638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1067/2115] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:31 2022] POST /identity/v3/users => generated 289 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:31.770848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:31.782977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da7b20d503d40e6879e7678022696ad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:31.784022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da7b20d503d40e6879e7678022696ad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:31.796012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febedbc2-e983-4b83-8d18-c531b40735b2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:31.803619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-c9208ef1-0baf-43dd-ba9e-95f40b986ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da7b20d503d40e6879e7678022696ad'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:31.814261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:31.814551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1049/2116] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:31 2022] DELETE /identity/v3/users/6da7b20d503d40e6879e7678022696ad => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:31.815612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.816355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.816696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.817643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:31.819345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:31.819593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:31.820019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:31.822797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:31.845918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1068/2117] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:31.853839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:31.857895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:31.872984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:31.874336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:31.901754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430f742-8c7b-41af-8e63-0fa62b1df78d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:32.016615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1050/2118] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:32.036141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:32.037152 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:32.063548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:32.065740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:32.066206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:32.066635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:32.067507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:32.069783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:32.074609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:32.099713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1069/2119] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:32.106069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:32.130280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87fdd9-0f7f-41de-b873-93a447bde7a9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:32.140354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:32.141031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:32.141298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:32.141577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] PATH_INFO: `/v3/projects/076144e2070b434c9d1fda1223cff4ed/users/4ba52b5b8b6f405396182116a4703a58/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:32.173142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43935a17-6873-4f34-b7d8-97d4a8464491 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:32.181742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e592aff-69da-49dd-87f3-1067868f550a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:32.182490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e592aff-69da-49dd-87f3-1067868f550a service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:32.186099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e592aff-69da-49dd-87f3-1067868f550a service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:32.186099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e592aff-69da-49dd-87f3-1067868f550a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:32.186528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=076144e2070b434c9d1fda1223cff4ed, user_id=4ba52b5b8b6f405396182116a4703a58, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:32.187622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:32.201648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e592aff-69da-49dd-87f3-1067868f550a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:32.203447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e592aff-69da-49dd-87f3-1067868f550a service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:32.217647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1051/2120] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:32.330909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1070/2121] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:32 2022] PUT /identity/v3/projects/076144e2070b434c9d1fda1223cff4ed/users/4ba52b5b8b6f405396182116a4703a58/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:32.341028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:32.341585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:32.341807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:32.399560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:32.402035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:32.579490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1052/2122] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:32.634794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:32.788839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b53670-3584-4c1b-b06e-6e9c003b1cfe admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:32.797824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6c737-358d-4d48-9e4a-fa82decc238d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:32.798383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c737-358d-4d48-9e4a-fa82decc238d service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:32.798824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c737-358d-4d48-9e4a-fa82decc238d service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:32.798933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6c737-358d-4d48-9e4a-fa82decc238d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:32.820033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6c737-358d-4d48-9e4a-fa82decc238d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:32.823013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6c737-358d-4d48-9e4a-fa82decc238d service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:32.864390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1071/2123] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:32.880233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:34.168324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:34.171017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:34.193174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6ecc6-e1ec-402e-9d3d-5201b95e51c2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:34.203121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:34.204169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:34.204704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:34.205771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] PATH_INFO: `/v3/projects/86f29fb9cf294d99afd22508d93db94e` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:34.210754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f29fb9cf294d99afd22508d93db94e)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:34.214167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:34.429040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f29fb9cf294d99afd22508d93db94e', 'request_id': 'req-80e1b128-5506-44da-b8cb-a972c4603dfc'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:34.515305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f29fb9cf294d99afd22508d93db94e', 'request_id': 'req-80e1b128-5506-44da-b8cb-a972c4603dfc'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:34.524423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f29fb9cf294d99afd22508d93db94e', 'request_id': 'req-80e1b128-5506-44da-b8cb-a972c4603dfc'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:34.550182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] The token cache is being invalidate because project 86f29fb9cf294d99afd22508d93db94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:34.556942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:34.557763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-80e1b128-5506-44da-b8cb-a972c4603dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:34.563462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1053/2124] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:34 2022] DELETE /identity/v3/projects/86f29fb9cf294d99afd22508d93db94e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:34.565652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e1e21-67ec-4639-9f2f-6f83d095e4ef None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:34.566186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e1e21-67ec-4639-9f2f-6f83d095e4ef None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:34.566186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e1e21-67ec-4639-9f2f-6f83d095e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:34.595661 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-df0e1e21-67ec-4639-9f2f-6f83d095e4ef None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:34.598332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-df0e1e21-67ec-4639-9f2f-6f83d095e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:34.657043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:34.711140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1072/2125] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:34.724374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2463-e5f4-449c-bc00-09d90658eda6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:34.724724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2463-e5f4-449c-bc00-09d90658eda6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:34.724979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f2463-e5f4-449c-bc00-09d90658eda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:34.759113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-586f2463-e5f4-449c-bc00-09d90658eda6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:34.760523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-586f2463-e5f4-449c-bc00-09d90658eda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:34.770623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1054/2126] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:34.775347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e1e21-67ec-4639-9f2f-6f83d095e4ef None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:34.799698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e1e21-67ec-4639-9f2f-6f83d095e4ef None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:34.807197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:34.810548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:34.810548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:34.810548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:34.810548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:34.810548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:34.812450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:34.860390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1073/2127] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:34.865484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f2463-e5f4-449c-bc00-09d90658eda6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:34.880137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f2463-e5f4-449c-bc00-09d90658eda6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:34.906754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:34.907738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:34.908322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:34.909288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:34.910071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:34.912738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:35.029998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1055/2128] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:34 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:59:35.031577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:35.048925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd8939-0b69-47cb-9ead-6edfbd3196e4 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:35.141914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:35.142723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:35.143290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:35.143668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:35.145198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:35.148678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:35.251845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:35.252997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1074/2129] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:35 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:35.274164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28649536-09ab-482e-b3d3-fcb96c67eb7e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:35.292527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:35.297807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:35.297807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:35.297807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:35.297807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:35.299981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:35.327255 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:35.332058 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1056/2130] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:35.342280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13957a-4511-4382-8ebe-a290bd28d60d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:35.355818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1076467-d8e6-413f-9de7-a9128afa664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:35.359068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1076467-d8e6-413f-9de7-a9128afa664c admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:35.359068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1076467-d8e6-413f-9de7-a9128afa664c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:35.359068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1076467-d8e6-413f-9de7-a9128afa664c admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:35.360218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1076467-d8e6-413f-9de7-a9128afa664c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:35.364718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1076467-d8e6-413f-9de7-a9128afa664c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:35.421845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1075/2131] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:35.422217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:35.441769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ac21c-0287-4faa-8983-9550fee0b871 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:35.450039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:35.451224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:35.451922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:35.452597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] PATH_INFO: `/v3/projects/7c6d100b442847c8a0564fd14e5a2e4f/users/a776079fbbf44342bea8e8d985f3abbe/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:35.499838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6d100b442847c8a0564fd14e5a2e4f, user_id=a776079fbbf44342bea8e8d985f3abbe, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:35.508983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:35.690625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1057/2132] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:35 2022] PUT /identity/v3/projects/7c6d100b442847c8a0564fd14e5a2e4f/users/a776079fbbf44342bea8e8d985f3abbe/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:35.790499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:35.790986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:35.791121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:35.843620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] MFA Rules not processed for user `a776079fbbf44342bea8e8d985f3abbe`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:35.845460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:35.975679 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1076/2133] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:35.980017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:35.982467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:36.072147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfedad5-76d2-4d4e-a5d6-11df3c84a412 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:36.077101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48088475-198c-400f-8d73-cbb4f51a1f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:36.077594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088475-198c-400f-8d73-cbb4f51a1f27 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:36.077868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088475-198c-400f-8d73-cbb4f51a1f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:36.078113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088475-198c-400f-8d73-cbb4f51a1f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:36.089272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48088475-198c-400f-8d73-cbb4f51a1f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:36.094151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48088475-198c-400f-8d73-cbb4f51a1f27 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:36.101723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1058/2134] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 09:59:36.984918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:36.984918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:37.055571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:37.101196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f75cbe-5bfd-4ad9-9a29-c7e137eb4185 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:37.113298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:37.114079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:37.114432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:37.115413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] PATH_INFO: `/v3/users/a701930f2f9a4015867dbee9961fd3d9` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:37.116266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a701930f2f9a4015867dbee9961fd3d9)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:37.119954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:37.414265 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a701930f2f9a4015867dbee9961fd3d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:37.595223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a701930f2f9a4015867dbee9961fd3d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:37.595223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a701930f2f9a4015867dbee9961fd3d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:37.603645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a701930f2f9a4015867dbee9961fd3d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:37.635728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a701930f2f9a4015867dbee9961fd3d9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:37.645713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1077/2135] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:36 2022] DELETE /identity/v3/users/a701930f2f9a4015867dbee9961fd3d9 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:37.658316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:37.659608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:37.659608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:37.726390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:37.729870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:37.778431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:37.925378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1059/2136] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:37.969917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:37.971639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:38.099253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2845be2-c66e-42f8-8988-fa2766d84bbf admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:38.107300 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:38.107939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:38.109715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:38.109715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:38.119393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:38.121415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:38.133725 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1078/2137] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:40.701010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:40.703801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:40.737900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87722f-1778-4fa5-85c5-25f22fb3b4d6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:40.758528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:40.768597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:40.768597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:40.768597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] PATH_INFO: `/v3/projects/416aacf433dd43e9bde1833d171d0e07` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:40.769591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=416aacf433dd43e9bde1833d171d0e07)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:40.771700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:40.950654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416aacf433dd43e9bde1833d171d0e07', 'request_id': 'req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.030430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416aacf433dd43e9bde1833d171d0e07', 'request_id': 'req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.041253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416aacf433dd43e9bde1833d171d0e07', 'request_id': 'req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.106491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] The token cache is being invalidate because project 416aacf433dd43e9bde1833d171d0e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:41.107374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.110181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.115911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1060/2138] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:40 2022] DELETE /identity/v3/projects/416aacf433dd43e9bde1833d171d0e07 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:41.121910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:41.134442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7789db-5138-4222-8746-128f1dcfb427 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:41.284109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:41.286345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:41.287410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:41.288047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] PATH_INFO: `/v3/users/d9b7252d86d745fbbe75f8973a570932` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:41.289710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b7252d86d745fbbe75f8973a570932)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:41.292411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:41.294446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:41.583469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b7252d86d745fbbe75f8973a570932'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.659670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b7252d86d745fbbe75f8973a570932'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.672029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b7252d86d745fbbe75f8973a570932'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.672029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b7252d86d745fbbe75f8973a570932'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.702765 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ab01a846-719b-4353-b0d6-d542ac0c5aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b7252d86d745fbbe75f8973a570932'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:41.730626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1079/2139] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:41 2022] DELETE /identity/v3/users/d9b7252d86d745fbbe75f8973a570932 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:42.784361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:42.786137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:42.808050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dc7f6-66d5-462a-aad5-a97dd4c8c4a4 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:42.918697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:42.919721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:42.921975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:42.921975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] PATH_INFO: `/v3/projects/b40109cf8c9445bd9177053c230110ac` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:42.921975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40109cf8c9445bd9177053c230110ac)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:42.925093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:43.104875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:43.114060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40109cf8c9445bd9177053c230110ac', 'request_id': 'req-76af1a2c-497a-48f9-8673-51d91b564692'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:43.192434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40109cf8c9445bd9177053c230110ac', 'request_id': 'req-76af1a2c-497a-48f9-8673-51d91b564692'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:43.201203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40109cf8c9445bd9177053c230110ac', 'request_id': 'req-76af1a2c-497a-48f9-8673-51d91b564692'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:43.219843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] The token cache is being invalidate because project b40109cf8c9445bd9177053c230110ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:43.223593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:43.225586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-76af1a2c-497a-48f9-8673-51d91b564692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:43.235124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1061/2140] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:42 2022] DELETE /identity/v3/projects/b40109cf8c9445bd9177053c230110ac => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:43.237743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a36c-7269-4c40-82a8-9a6ec6677f40 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:43.238223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a36c-7269-4c40-82a8-9a6ec6677f40 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:43.238384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a36c-7269-4c40-82a8-9a6ec6677f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:43.263310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4ee1a36c-7269-4c40-82a8-9a6ec6677f40 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:43.265084 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4ee1a36c-7269-4c40-82a8-9a6ec6677f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:43.379223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed459b5-1cf7-43eb-91f2-8161abb5bd48 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:43.379890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed459b5-1cf7-43eb-91f2-8161abb5bd48 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:43.380313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1080/2141] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:43.380457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed459b5-1cf7-43eb-91f2-8161abb5bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:43.410372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-5ed459b5-1cf7-43eb-91f2-8161abb5bd48 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:43.412161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5ed459b5-1cf7-43eb-91f2-8161abb5bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:43.430226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a36c-7269-4c40-82a8-9a6ec6677f40 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:43.438122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1062/2142] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:43.444731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a36c-7269-4c40-82a8-9a6ec6677f40 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:43.451698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:43.452718 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:43.453145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:43.453723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:43.454777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:43.455324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:43.457424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:43.477425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1081/2143] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:43.483082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed459b5-1cf7-43eb-91f2-8161abb5bd48 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:43.496970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed459b5-1cf7-43eb-91f2-8161abb5bd48 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:43.502105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:43.504495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:43.504836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:43.505111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:43.505774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:43.509077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:43.668873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1063/2144] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:43 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:43.669227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:43.691790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708814c-8054-4e68-96ca-5ddb9dc9f0f7 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:43.829465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:43.830471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:43.833391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:43.833391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:43.836416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:43.842848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:43.869859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:43.975958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1082/2145] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:43 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:59:43.976391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:43.993961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab64e67-a449-478e-8f69-1da68e2e3f28 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:44.007195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:44.007195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:44.007195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:44.007764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:44.008928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:44.012327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:44.028941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1064/2146] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:44.034428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:44.051173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b649f-47cb-4d49-8198-f4b958aba9c1 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:44.059541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7622f1-fc1b-44e4-bad2-da72a249c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:44.060126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7622f1-fc1b-44e4-bad2-da72a249c328 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:44.060443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7622f1-fc1b-44e4-bad2-da72a249c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:44.060769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7622f1-fc1b-44e4-bad2-da72a249c328 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:44.061415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7622f1-fc1b-44e4-bad2-da72a249c328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:44.063446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7622f1-fc1b-44e4-bad2-da72a249c328 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:44.090945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1083/2147] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:44.092598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:44.109344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4380759-1c13-487f-b40e-d9de17367330 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:44.120522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:44.123213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:44.124183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:44.125926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] PATH_INFO: `/v3/projects/ba3b6b60984541799663de9aa89dec12/users/9807dbfd5e884736be255d240c50f522/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:44.153341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3b6b60984541799663de9aa89dec12, user_id=9807dbfd5e884736be255d240c50f522, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:44.165041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:44.269955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1065/2148] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:44 2022] PUT /identity/v3/projects/ba3b6b60984541799663de9aa89dec12/users/9807dbfd5e884736be255d240c50f522/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:44.282014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01891f-7ca6-4f81-ac94-c83ff197514d None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:44.282915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01891f-7ca6-4f81-ac94-c83ff197514d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:44.283337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01891f-7ca6-4f81-ac94-c83ff197514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:44.319436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6f01891f-7ca6-4f81-ac94-c83ff197514d None None] MFA Rules not processed for user `9807dbfd5e884736be255d240c50f522`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:44.322481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6f01891f-7ca6-4f81-ac94-c83ff197514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:44.462033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:44.465012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1084/2149] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:44.587203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2aa9f-1b41-4766-b988-dd8ff78338a2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:44.607679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:44.609510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:44.609800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:44.610079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:44.610928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:44.614555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:44.735984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1066/2150] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:44 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 09:59:44.741141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01891f-7ca6-4f81-ac94-c83ff197514d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:44.756323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01891f-7ca6-4f81-ac94-c83ff197514d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:44.934777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:44.935706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:44.936181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:44.936855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:44.938010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:44.943869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:45.147588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1085/2151] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:44 2022] POST /identity/v3/users => generated 289 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:45.151991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:45.171666 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b5f8c-3516-44db-bc67-da1440938d99 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:45.182184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:45.182184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:45.182184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:45.182184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:45.182556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:45.183290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:45.216775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:45.222702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1067/2152] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:45.229443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0326fb-6df7-47ff-9d49-0dfec16e8d8d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:45.240481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:45.248354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:45.249292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:45.249697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] PATH_INFO: `/v3/projects/8a906bc55264426395555daf935aaefc/users/51341feebd2540659959ba6870c8045d/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:45.289326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a906bc55264426395555daf935aaefc, user_id=51341feebd2540659959ba6870c8045d, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:45.300331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:45.489528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1086/2153] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:45 2022] PUT /identity/v3/projects/8a906bc55264426395555daf935aaefc/users/51341feebd2540659959ba6870c8045d/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:45.493876 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:45.510516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b78b0-d9c4-44da-b191-3217ef8e3371 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:45.635341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:45.664865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30943ee-b34e-41bc-b6c8-91cc4538d5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:45.665899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30943ee-b34e-41bc-b6c8-91cc4538d5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:45.667234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30943ee-b34e-41bc-b6c8-91cc4538d5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:45.667993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30943ee-b34e-41bc-b6c8-91cc4538d5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:45.669284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30943ee-b34e-41bc-b6c8-91cc4538d5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:45.671473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30943ee-b34e-41bc-b6c8-91cc4538d5f1 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:45.703404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1068/2154] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:45.704697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:45.729379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6d688-5131-4ce3-8656-4fdab81c9fef admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:45.748048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:45.749070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:45.749450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:45.749820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] PATH_INFO: `/v3/projects/8a906bc55264426395555daf935aaefc/users/51341feebd2540659959ba6870c8045d/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:45.753259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a906bc55264426395555daf935aaefc, user_id=51341feebd2540659959ba6870c8045d, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:45.758356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:45.784684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1087/2155] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:45 2022] PUT /identity/v3/projects/8a906bc55264426395555daf935aaefc/users/51341feebd2540659959ba6870c8045d/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:45.784829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:45.784829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:45.784997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:45.864291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] MFA Rules not processed for user `51341feebd2540659959ba6870c8045d`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:45.875164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:46.178170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1069/2156] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:46.233321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:46.235309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:46.355734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:46.428711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf98763-a2c8-42e7-83ea-e4e5188121e6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:46.437646 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:46.439006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:46.439382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:46.439898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:46.462219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:46.464279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:46.492716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1088/2157] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:52.750194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:52.753698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:52.790319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbea5d-9ed7-4925-8672-208873f134b5 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:52.801269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:52.802436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:52.804020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:52.804767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:52.955105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:52.957237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:52.976178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1070/2158] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:52.981831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:52.983529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:53.126534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79120d-7954-4882-937a-04cefbbb2f25 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:53.133737 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9bdb2-90d7-4c50-a09d-748dc32560b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:53.136007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9bdb2-90d7-4c50-a09d-748dc32560b7 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:53.136007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9bdb2-90d7-4c50-a09d-748dc32560b7 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:53.136007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9bdb2-90d7-4c50-a09d-748dc32560b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:53.137633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-03c9bdb2-90d7-4c50-a09d-748dc32560b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:53.152402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9bdb2-90d7-4c50-a09d-748dc32560b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:53.154275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9bdb2-90d7-4c50-a09d-748dc32560b7 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:53.174825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1089/2159] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:53.234399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:53.236074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:53.329956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daacc9-c356-4397-9612-719e04e0ee2f service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:53.342310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:53.344839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:53.344839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:53.344839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] PATH_INFO: `/v3/users/5bfef6460caf4de99f6dc1fe054307a4` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:53.347597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfef6460caf4de99f6dc1fe054307a4)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:53.353707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:53.359684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:53.606559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfef6460caf4de99f6dc1fe054307a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.711876 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfef6460caf4de99f6dc1fe054307a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.745540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfef6460caf4de99f6dc1fe054307a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.746297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfef6460caf4de99f6dc1fe054307a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.759862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfef6460caf4de99f6dc1fe054307a4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:53.800581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:53.800865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:53.801424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:53.801728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1071/2160] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:53 2022] DELETE /identity/v3/users/5bfef6460caf4de99f6dc1fe054307a4 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:53.839320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:53.840856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:53.980903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1090/2161] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 09:59:54.066965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:54.071570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:54.200764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692abfed-88ed-4042-bcf4-a60588f0e4b5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:54.207160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:54.208082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:54.211191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:54.212215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:54.251223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:54.264991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:54.281615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1072/2162] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:54.788191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:54.791057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:54.955770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:54.963809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4164f-1e50-4a79-9992-9d4dff796d56 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:54.975879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438095a4-6da3-431d-8d5e-0cf4311dbfd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:54.978241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438095a4-6da3-431d-8d5e-0cf4311dbfd3 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:54.979918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438095a4-6da3-431d-8d5e-0cf4311dbfd3 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:54.980420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438095a4-6da3-431d-8d5e-0cf4311dbfd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:54.984445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-438095a4-6da3-431d-8d5e-0cf4311dbfd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:55.009046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438095a4-6da3-431d-8d5e-0cf4311dbfd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.012186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438095a4-6da3-431d-8d5e-0cf4311dbfd3 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.027047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1091/2163] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:55.200612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:55.204572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:55.286031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ae979-598e-40a0-a6cf-a96e9f2ef865 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:55.327170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:55.328098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.328377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.328860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] PATH_INFO: `/v3/users/fa4e9b7c4dbf4f9197c089fad453244f` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.333244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4e9b7c4dbf4f9197c089fad453244f)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:55.340975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:55.626298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4e9b7c4dbf4f9197c089fad453244f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:55.731557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4e9b7c4dbf4f9197c089fad453244f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:55.757783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4e9b7c4dbf4f9197c089fad453244f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:55.759449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4e9b7c4dbf4f9197c089fad453244f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:55.780158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7591c2a8-d0d9-4724-be99-5b3551e744b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4e9b7c4dbf4f9197c089fad453244f'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:55.782319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:55.802402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1073/2164] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:55 2022] DELETE /identity/v3/users/fa4e9b7c4dbf4f9197c089fad453244f => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:55.807574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.808309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.808309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:55.854330 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:55.854499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:55.927111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:55.930016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:55.933447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.050273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] MFA Rules not processed for user `4ba52b5b8b6f405396182116a4703a58`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:56.051474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.120603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1092/2165] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:56.135226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.138582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.176176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602b2d3-9487-45c1-95a0-f3e81cc76bf6 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.193109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.195090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.196018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.196743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] PATH_INFO: `/v3/projects/f0a2e694ad734b67b2fe5e3b8b1efc8b` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.201555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a2e694ad734b67b2fe5e3b8b1efc8b)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:56.206267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:56.281734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1074/2166] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:56.283395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.288953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.398775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a2e694ad734b67b2fe5e3b8b1efc8b', 'request_id': 'req-6bb51276-9506-41f0-ba04-46f1936739d0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:56.449003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a894e-f4a0-4fb0-aeac-f2e590006a62 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.522015 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a2e694ad734b67b2fe5e3b8b1efc8b', 'request_id': 'req-6bb51276-9506-41f0-ba04-46f1936739d0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:56.533221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a2e694ad734b67b2fe5e3b8b1efc8b', 'request_id': 'req-6bb51276-9506-41f0-ba04-46f1936739d0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:56.574129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] The token cache is being invalidate because project f0a2e694ad734b67b2fe5e3b8b1efc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:56.574350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:56.575278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:56.577047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1093/2167] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:56 2022] DELETE /identity/v3/projects/f0a2e694ad734b67b2fe5e3b8b1efc8b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:56.579479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.583294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.597244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675b22b-d7f6-4bdd-8858-412ab970dcba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.597888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675b22b-d7f6-4bdd-8858-412ab970dcba service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.598163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675b22b-d7f6-4bdd-8858-412ab970dcba service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.598431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675b22b-d7f6-4bdd-8858-412ab970dcba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.604754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7675b22b-d7f6-4bdd-8858-412ab970dcba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.764358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:56.785298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675b22b-d7f6-4bdd-8858-412ab970dcba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:56.790084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675b22b-d7f6-4bdd-8858-412ab970dcba service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:56.819254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb51276-9506-41f0-ba04-46f1936739d0 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.823505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1075/2168] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:56.825522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.826409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.827351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.839557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7610c-45d7-404b-a1a8-84d49fd91cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.840168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7610c-45d7-404b-a1a8-84d49fd91cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.840446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7610c-45d7-404b-a1a8-84d49fd91cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.840719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7610c-45d7-404b-a1a8-84d49fd91cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.841372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7610c-45d7-404b-a1a8-84d49fd91cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:56.845613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7610c-45d7-404b-a1a8-84d49fd91cb8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:56.861387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:56.865918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.878005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1076/2169] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:56.878948 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:56.890291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:56.912305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091128b7-a7cf-477f-897a-e48d112c31fc None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:56.924539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:56.925650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:56.926107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:56.926539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] PATH_INFO: `/v3/users/9807dbfd5e884736be255d240c50f522` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:56.931623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9807dbfd5e884736be255d240c50f522)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:56.940894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.037482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:57.064834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1094/2170] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:56 2022] POST /identity/v3/projects => generated 379 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:57.065550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb47c-0668-4468-8e52-3d14cce33a95 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.066033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb47c-0668-4468-8e52-3d14cce33a95 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.066497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb47c-0668-4468-8e52-3d14cce33a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.117326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2a8fb47c-0668-4468-8e52-3d14cce33a95 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:57.119701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2a8fb47c-0668-4468-8e52-3d14cce33a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:57.303226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9807dbfd5e884736be255d240c50f522'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:57.364591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1095/2171] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:57.377716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb47c-0668-4468-8e52-3d14cce33a95 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.418143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb47c-0668-4468-8e52-3d14cce33a95 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.425421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9807dbfd5e884736be255d240c50f522'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:57.444089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed201ab-eb97-4eaa-8b76-6826659826d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.445089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed201ab-eb97-4eaa-8b76-6826659826d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.445578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed201ab-eb97-4eaa-8b76-6826659826d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.446114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed201ab-eb97-4eaa-8b76-6826659826d6 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.447498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed201ab-eb97-4eaa-8b76-6826659826d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.461891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed201ab-eb97-4eaa-8b76-6826659826d6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.515361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9807dbfd5e884736be255d240c50f522'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:57.517014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9807dbfd5e884736be255d240c50f522'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:57.544935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9807dbfd5e884736be255d240c50f522'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:57.562611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1077/2172] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:56 2022] DELETE /identity/v3/users/9807dbfd5e884736be255d240c50f522 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:57.569834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.573424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:57.621148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1096/2173] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:57 2022] POST /identity/v3/users => generated 296 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:57.621148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.621148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.621148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.667354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:57.668011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:57.726207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52a95f-96c8-4557-89d0-cbfde3020201 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.732197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.733619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.733619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.734337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.735106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 09:59:57.735412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.737362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.755536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1078/2174] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 09:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 09:59:57.755536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.757937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:57.772391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc69d4-eb0e-40d1-b83b-26ef5de74aa2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.780383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.781730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.782322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.782598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.784305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.785495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.798579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1097/2175] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 09:59:57.800495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.803668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:57.805640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1079/2176] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:57.806695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:57.820008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106358d3-ec88-4854-80b2-fbbc865bc23a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.825250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d28a0-81a8-4c7e-8ba1-2f64e8e1721f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:57.826662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.827034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.827290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.827615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.828327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.829527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:57.830262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.831032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:57.831445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:57.832005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] PATH_INFO: `/v3/projects/abb615b8ad924198b6603af289d65e34` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:57.834040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb615b8ad924198b6603af289d65e34)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:57.836761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:57.971572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1080/2177] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 09:59:57 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:57.973268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.008472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:58.078631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb615b8ad924198b6603af289d65e34', 'request_id': 'req-ae423b74-653c-43eb-a1e3-0fc61adaac98'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:58.104287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9ff4-33f2-43ce-86bb-1d4a1990d27d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.208405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb615b8ad924198b6603af289d65e34', 'request_id': 'req-ae423b74-653c-43eb-a1e3-0fc61adaac98'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:58.218317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb615b8ad924198b6603af289d65e34', 'request_id': 'req-ae423b74-653c-43eb-a1e3-0fc61adaac98'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:58.251471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.253995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.255864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.256302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] PATH_INFO: `/v3/projects/0a25ffaef1b74d34b52eff683648c46a/users/85c7dc344c8f48989fa9c48d94414fe1/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.257753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] The token cache is being invalidate because project abb615b8ad924198b6603af289d65e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 09:59:58.258038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:58.258807 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:58.260672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1098/2178] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:57 2022] DELETE /identity/v3/projects/abb615b8ad924198b6603af289d65e34 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:58.261772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.265611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.298571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a25ffaef1b74d34b52eff683648c46a, user_id=85c7dc344c8f48989fa9c48d94414fe1, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.303636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:58.406346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae423b74-653c-43eb-a1e3-0fc61adaac98 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.416913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.417677 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.417862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.418079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.424870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1081/2179] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:57 2022] PUT /identity/v3/projects/0a25ffaef1b74d34b52eff683648c46a/users/85c7dc344c8f48989fa9c48d94414fe1/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:58.424870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.425957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.428016 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.465599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.467153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:58.496793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1099/2180] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 09:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 09:59:58.496793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.505336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.538649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb2fc-96c9-48ce-8a5a-6a922513f080 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.641959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b86cba-35d1-402d-bf64-7a5304258835 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.665228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.666213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.666661 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.668339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.669493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.676107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:58.728605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.728605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.728929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.729163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] PATH_INFO: `/v3/users/45d81840be8243a380ee4ef9ee516347` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.734316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d81840be8243a380ee4ef9ee516347)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.743826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:58.833726 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:58.844342 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1082/2181] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 09:59:58 2022] POST /identity/v3/users => generated 286 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 09:59:58.844342 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.848639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:58.911678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d80ced-ba02-4bce-ab41-de199204103a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:58.927935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:58.928579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:58.932721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:58.932721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:58.932721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:58.933284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:58.969869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1083/2182] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:58.975228 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:58.997373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39593e-b4bf-43b7-b053-be08d953be43 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:59.009637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:59.010300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.010583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.010883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.011531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:59.015080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:59.040827 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1084/2183] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:59.041748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:59.056604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d81840be8243a380ee4ef9ee516347'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.069233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3b222-f832-43df-bb48-45420ca0c7ca admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:59.083229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:59.083229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.083229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.083229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] PATH_INFO: `/v3/projects/0a25ffaef1b74d34b52eff683648c46a/users/85c7dc344c8f48989fa9c48d94414fe1/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.088010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a25ffaef1b74d34b52eff683648c46a, user_id=85c7dc344c8f48989fa9c48d94414fe1, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:59.095468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:59.169019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1085/2184] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:59 2022] PUT /identity/v3/projects/0a25ffaef1b74d34b52eff683648c46a/users/85c7dc344c8f48989fa9c48d94414fe1/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:59.169019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:59.175464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d81840be8243a380ee4ef9ee516347'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.179171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d81840be8243a380ee4ef9ee516347'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.207573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d81840be8243a380ee4ef9ee516347'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.275119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d81840be8243a380ee4ef9ee516347'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 09:59:59.286059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1100/2185] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 09:59:58 2022] DELETE /identity/v3/users/45d81840be8243a380ee4ef9ee516347 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:59.297642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def398d-6649-46af-bdc8-8408ed7cc39a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:59.495687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cfc9b-d6fc-49b4-b4d5-499649fe8b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:59.496318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cfc9b-d6fc-49b4-b4d5-499649fe8b76 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.496718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cfc9b-d6fc-49b4-b4d5-499649fe8b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.497075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cfc9b-d6fc-49b4-b4d5-499649fe8b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.498025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cfc9b-d6fc-49b4-b4d5-499649fe8b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:59.499779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cfc9b-d6fc-49b4-b4d5-499649fe8b76 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:59.526300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1086/2186] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 09:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 09:59:59.532827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:59.536501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:59.566216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135e2b5-726a-44d3-8329-4b455b4221ad admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 09:59:59.569386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 09:59:59.570477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.571257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.572204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] PATH_INFO: `/v3/projects/ca63ccf8f825493e97e93fc2a91c67ac/users/c2b2a5f359384a179f8cfa23692f3bee/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.599369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca63ccf8f825493e97e93fc2a91c67ac, user_id=c2b2a5f359384a179f8cfa23692f3bee, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 09:59:59.603577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 09:59:59.650535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:59.702168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1101/2187] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 09:59:59 2022] PUT /identity/v3/projects/ca63ccf8f825493e97e93fc2a91c67ac/users/c2b2a5f359384a179f8cfa23692f3bee/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 09:59:59.712895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 09:59:59.713414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 09:59:59.713754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 09:59:59.788651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] MFA Rules not processed for user `c2b2a5f359384a179f8cfa23692f3bee`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 09:59:59.789899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:59.866656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 09:59:59.869382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 09:59:59.948481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1087/2188] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 09:59:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:00.019025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:00.020548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:00.117373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee9fa-ffac-4f53-a148-9133aa2cd9fe admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:00.126991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:00.128322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:00.128885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:00.129899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] PATH_INFO: `/v3/projects/ba3b6b60984541799663de9aa89dec12` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:00.131713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3b6b60984541799663de9aa89dec12)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:00.136510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:00.184135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2f9a-9a87-43ea-af83-3c11523671d1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:00.188178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:00.189002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:00.189124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:00.189333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:00.216213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:00.218027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:00.239216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1088/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:00.267679 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:00.342165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3b6b60984541799663de9aa89dec12', 'request_id': 'req-fd2cb101-0add-45aa-bec1-54e053b772fc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:00.425549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3b6b60984541799663de9aa89dec12', 'request_id': 'req-fd2cb101-0add-45aa-bec1-54e053b772fc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:00.435151 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3b6b60984541799663de9aa89dec12', 'request_id': 'req-fd2cb101-0add-45aa-bec1-54e053b772fc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:00.470180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] The token cache is being invalidate because project ba3b6b60984541799663de9aa89dec12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:00.471756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:00.473123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:00.479954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1102/2190] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:59 2022] DELETE /identity/v3/projects/ba3b6b60984541799663de9aa89dec12 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:00.483946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:00.501539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b301-6c57-4f27-8d05-bebb7be631a8 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:00.774043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:00.774786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:00.775243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:00.776899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] PATH_INFO: `/v3/users/51341feebd2540659959ba6870c8045d` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:00.778462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51341feebd2540659959ba6870c8045d)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:00.781822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:00.922446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:01.075550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51341feebd2540659959ba6870c8045d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.212049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51341feebd2540659959ba6870c8045d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.239818 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51341feebd2540659959ba6870c8045d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.241544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51341feebd2540659959ba6870c8045d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.256803 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-9a7fa978-a8dc-4033-970d-a71bd8e5dc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51341feebd2540659959ba6870c8045d'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:01.273439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1089/2191] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:00 2022] DELETE /identity/v3/users/51341feebd2540659959ba6870c8045d => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:01.443218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:01.460059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:01.467158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb101-0add-45aa-bec1-54e053b772fc admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:01.645062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:01.651166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:01.651836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:01.652310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] PATH_INFO: `/v3/projects/3cafc17f01f94eb8b1eba4ae92ced742` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:01.653973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cafc17f01f94eb8b1eba4ae92ced742)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:01.656416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:01.907957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cafc17f01f94eb8b1eba4ae92ced742', 'request_id': 'req-b8e3cb15-b255-4c13-a233-d845f9387c32'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:02.047970 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cafc17f01f94eb8b1eba4ae92ced742', 'request_id': 'req-b8e3cb15-b255-4c13-a233-d845f9387c32'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:02.062424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cafc17f01f94eb8b1eba4ae92ced742', 'request_id': 'req-b8e3cb15-b255-4c13-a233-d845f9387c32'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:02.089377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] The token cache is being invalidate because project 3cafc17f01f94eb8b1eba4ae92ced742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:02.091565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:02.091565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b8e3cb15-b255-4c13-a233-d845f9387c32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:02.092225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1103/2192] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:01 2022] DELETE /identity/v3/projects/3cafc17f01f94eb8b1eba4ae92ced742 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:02.097645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266895-d10f-40ae-a45f-a64febb5a49c None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:02.098994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266895-d10f-40ae-a45f-a64febb5a49c None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:02.099523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266895-d10f-40ae-a45f-a64febb5a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:02.157763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0d266895-d10f-40ae-a45f-a64febb5a49c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:02.160410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0d266895-d10f-40ae-a45f-a64febb5a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:02.268674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:02.295706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1090/2193] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:02.309934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cafeb1-db5c-4216-af59-108667b5dca8 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:02.313449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cafeb1-db5c-4216-af59-108667b5dca8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:02.313976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cafeb1-db5c-4216-af59-108667b5dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:02.349333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-66cafeb1-db5c-4216-af59-108667b5dca8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:02.351184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-66cafeb1-db5c-4216-af59-108667b5dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:02.364647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1104/2194] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:02.367934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d266895-d10f-40ae-a45f-a64febb5a49c None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:02.411551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d266895-d10f-40ae-a45f-a64febb5a49c None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:02.434391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:02.435112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:02.435391 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:02.435659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:02.436326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:02.437494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:02.443280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:02.478983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1091/2195] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:02.484063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cafeb1-db5c-4216-af59-108667b5dca8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:02.500630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cafeb1-db5c-4216-af59-108667b5dca8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:02.521985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:02.522697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:02.522985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:02.523253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:02.524024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:02.526579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:02.615600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:02.696783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1105/2196] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:02 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:02.700069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:02.716097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d61b-482a-483a-9beb-449b841cb91f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:02.844667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:02.845343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:02.845622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:02.845895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:02.846819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:02.857757 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:02.977146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1092/2197] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:02 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:00:02.981067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.003586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500121c1-3cbd-4c99-9a1a-87b23681f9c6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.018894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.018894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.018894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.018894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.019263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:03.021378 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:03.047013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1106/2198] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:03.051544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.063028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffa5aa-3055-4d85-9201-055d459ca28d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.089458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ab3ec-5159-4b34-83d1-c22269fc3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.090092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab3ec-5159-4b34-83d1-c22269fc3736 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.090373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab3ec-5159-4b34-83d1-c22269fc3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.090743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab3ec-5159-4b34-83d1-c22269fc3736 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.091458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ab3ec-5159-4b34-83d1-c22269fc3736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:03.093182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ab3ec-5159-4b34-83d1-c22269fc3736 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:03.118989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.119216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1093/2199] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:03.151173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5697391-908d-4d95-8a28-6306e0321f4f admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.167652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.168340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.171528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.171528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] PATH_INFO: `/v3/projects/9a1bf00f79d448c7a7912346df6ce673/users/f941f420b18547f7b50353644f294ae8/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.210827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1bf00f79d448c7a7912346df6ce673, user_id=f941f420b18547f7b50353644f294ae8, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:03.213636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:03.333619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1107/2200] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:03 2022] PUT /identity/v3/projects/9a1bf00f79d448c7a7912346df6ce673/users/f941f420b18547f7b50353644f294ae8/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:00:03.344414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59786-8e31-4f15-9546-f42c1659ec48 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.344699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59786-8e31-4f15-9546-f42c1659ec48 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.344977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59786-8e31-4f15-9546-f42c1659ec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.388336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.390121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:03.409926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-baf59786-8e31-4f15-9546-f42c1659ec48 None None] MFA Rules not processed for user `f941f420b18547f7b50353644f294ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:03.411820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-baf59786-8e31-4f15-9546-f42c1659ec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:03.528121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1837f-172e-427c-8c18-066c77f08894 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.535788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.536443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.537433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.537856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] PATH_INFO: `/v3/projects/8a906bc55264426395555daf935aaefc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.539199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a906bc55264426395555daf935aaefc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:03.541685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:03.604903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1094/2201] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:03.689672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a906bc55264426395555daf935aaefc', 'request_id': 'req-09fb2654-bf34-46b5-8f63-943734c551b0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.786052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a906bc55264426395555daf935aaefc', 'request_id': 'req-09fb2654-bf34-46b5-8f63-943734c551b0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.794029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a906bc55264426395555daf935aaefc', 'request_id': 'req-09fb2654-bf34-46b5-8f63-943734c551b0'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.817204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] The token cache is being invalidate because project 8a906bc55264426395555daf935aaefc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:03.817409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.818223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:03.849558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1108/2202] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:03 2022] DELETE /identity/v3/projects/8a906bc55264426395555daf935aaefc => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:03.855667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9479a-c979-4030-a14b-063a138d6dcf None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.856368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9479a-c979-4030-a14b-063a138d6dcf None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.857290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9479a-c979-4030-a14b-063a138d6dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:03.891555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:03.893565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:03.916726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a1c9479a-c979-4030-a14b-063a138d6dcf None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:03.918788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a1c9479a-c979-4030-a14b-063a138d6dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:03.987239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb2654-bf34-46b5-8f63-943734c551b0 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:03.996949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:03.999381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:03.999381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:03.999596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.003587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:04.027890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:04.065706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1095/2203] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:04.073868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1d16-8437-4ea6-8edc-ed7cf76d7fb9 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.073868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1d16-8437-4ea6-8edc-ed7cf76d7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.074240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b1d16-8437-4ea6-8edc-ed7cf76d7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.099014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-028b1d16-8437-4ea6-8edc-ed7cf76d7fb9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:04.101954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-028b1d16-8437-4ea6-8edc-ed7cf76d7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:04.106927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.109123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.119761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1096/2204] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:04.121318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1d16-8437-4ea6-8edc-ed7cf76d7fb9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.122589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1109/2205] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:04.131486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b1d16-8437-4ea6-8edc-ed7cf76d7fb9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.136465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.137085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.137358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.137804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.138458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:04.138794 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.140408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.157506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1097/2206] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:04.163161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.177427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be2faf-8746-420c-86f8-0a6304981ed4 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.183166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.183846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.184134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.184408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.185116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.187391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.265521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:04.329392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1110/2207] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:04 2022] POST /identity/v3/projects => generated 359 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:04.332572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.359117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cdf0a-6c6a-44c4-9f1f-c76fce4bc1f4 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.527637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.528456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.528843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.529927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.530837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.533040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.793092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1098/2208] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:04 2022] POST /identity/v3/users => generated 280 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:04.816998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.816998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5701d-149c-46b7-8d00-93e59be7814e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.824388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.827944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.829613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.830222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.831781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.834563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.866039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1111/2209] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:04.870837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.892108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed8faf-143b-4edc-9485-667baceed02a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.901928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb095e83-657c-4780-a713-7d2f90798093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.902572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095e83-657c-4780-a713-7d2f90798093 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.902919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095e83-657c-4780-a713-7d2f90798093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.903193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb095e83-657c-4780-a713-7d2f90798093 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.903993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb095e83-657c-4780-a713-7d2f90798093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.906173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb095e83-657c-4780-a713-7d2f90798093 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:04.924890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1099/2210] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:04.926353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:04.944321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935a0f0-cfbd-4924-bf71-9a88fe258bb0 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:04.951258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:04.953043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:04.953334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:04.954282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] PATH_INFO: `/v3/projects/2e2b0df30914433097c544ce0c429d35/users/9fe18de25036443d9161292e4df86775/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:04.985371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2b0df30914433097c544ce0c429d35, user_id=9fe18de25036443d9161292e4df86775, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:04.998940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:05.158526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1112/2211] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:04 2022] PUT /identity/v3/projects/2e2b0df30914433097c544ce0c429d35/users/9fe18de25036443d9161292e4df86775/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:05.172553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076190e8-85e1-4485-9917-f2644467fdc2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:05.173313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076190e8-85e1-4485-9917-f2644467fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:05.173313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076190e8-85e1-4485-9917-f2644467fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:05.252105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-076190e8-85e1-4485-9917-f2644467fdc2 None None] MFA Rules not processed for user `9fe18de25036443d9161292e4df86775`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:05.255473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-076190e8-85e1-4485-9917-f2644467fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:05.359118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1100/2212] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:05.373108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:05.464402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c72b-7230-4197-baa9-7046b0ab8c61 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:05.469778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:05.470628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:05.471140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:05.472216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:05.485524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:05.488036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:05.503681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1113/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:00:06.420069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:11.481587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076190e8-85e1-4485-9917-f2644467fdc2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:11.493643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076190e8-85e1-4485-9917-f2644467fdc2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:11.499528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b15cbb-1315-44be-a9a5-e7ebe98629df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:11.500744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15cbb-1315-44be-a9a5-e7ebe98629df service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:11.501180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15cbb-1315-44be-a9a5-e7ebe98629df service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:11.501823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b15cbb-1315-44be-a9a5-e7ebe98629df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:11.506981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-78b15cbb-1315-44be-a9a5-e7ebe98629df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:11.635555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:11.675155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b15cbb-1315-44be-a9a5-e7ebe98629df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:11.679069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b15cbb-1315-44be-a9a5-e7ebe98629df service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:11.741669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1101/2214] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:16.178107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:16.179831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:16.413353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7071a-c4cc-403a-9ee6-e02bf649d254 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:16.430913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:16.431577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:16.431859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:16.432136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] PATH_INFO: `/v3/users/4b951d4e3a8446bc8542b88c63c1d31e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:16.433407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b951d4e3a8446bc8542b88c63c1d31e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:16.435540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:16.723510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b951d4e3a8446bc8542b88c63c1d31e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:16.825355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b951d4e3a8446bc8542b88c63c1d31e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:16.826139 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b951d4e3a8446bc8542b88c63c1d31e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:16.840317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b951d4e3a8446bc8542b88c63c1d31e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:16.882128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b951d4e3a8446bc8542b88c63c1d31e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:16.898519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1114/2215] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:16 2022] DELETE /identity/v3/users/4b951d4e3a8446bc8542b88c63c1d31e => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:16.902981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:16.902981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:16.902981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:16.983168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:16.993404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:17.172851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1102/2216] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:17.234310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:17.235673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:17.451445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33eb12-60b8-4882-912f-ca1376525f68 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:17.466991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45bfac-e141-4d22-b8ca-9ff2c1dbe7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:17.479688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45bfac-e141-4d22-b8ca-9ff2c1dbe7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:17.480360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45bfac-e141-4d22-b8ca-9ff2c1dbe7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:17.481245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45bfac-e141-4d22-b8ca-9ff2c1dbe7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:17.548385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45bfac-e141-4d22-b8ca-9ff2c1dbe7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:17.550741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45bfac-e141-4d22-b8ca-9ff2c1dbe7f1 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:17.584438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1115/2217] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:18.536733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:18.538891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:18.559523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f286-b4f5-4e9d-8b23-fb5646efb22f None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:18.588762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:18.591199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:18.591636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:18.598567 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] PATH_INFO: `/v3/projects/2ac8c601319445fc94d96de4c443d6c0` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:18.601083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac8c601319445fc94d96de4c443d6c0)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:18.603441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:18.784547 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac8c601319445fc94d96de4c443d6c0', 'request_id': 'req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:18.895384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac8c601319445fc94d96de4c443d6c0', 'request_id': 'req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:18.920740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac8c601319445fc94d96de4c443d6c0', 'request_id': 'req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:18.945443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] The token cache is being invalidate because project 2ac8c601319445fc94d96de4c443d6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:18.946192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:18.947379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-693219eb-2b4e-4eb3-9d57-d5dbd7b58bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:18.953311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1103/2218] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:18 2022] DELETE /identity/v3/projects/2ac8c601319445fc94d96de4c443d6c0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:18.955475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a82042-8375-4011-a08e-59980cd9b9a1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:18.955993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a82042-8375-4011-a08e-59980cd9b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:18.956570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a82042-8375-4011-a08e-59980cd9b9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:18.998545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-88a82042-8375-4011-a08e-59980cd9b9a1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:19.001719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-88a82042-8375-4011-a08e-59980cd9b9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:19.015857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:19.164625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1116/2219] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:19.175760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e80af-ca7a-4537-8e0f-713eafd4e882 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.179860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e80af-ca7a-4537-8e0f-713eafd4e882 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.179860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e80af-ca7a-4537-8e0f-713eafd4e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.243468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-401e80af-ca7a-4537-8e0f-713eafd4e882 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:19.251350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-401e80af-ca7a-4537-8e0f-713eafd4e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:19.275761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1104/2220] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:19.280095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a82042-8375-4011-a08e-59980cd9b9a1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:19.292345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a82042-8375-4011-a08e-59980cd9b9a1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:19.316311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:19.317838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.317838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.317838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.318248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:19.318405 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:19.320440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:19.348913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1117/2221] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:19.354522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e80af-ca7a-4537-8e0f-713eafd4e882 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:19.378121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e80af-ca7a-4537-8e0f-713eafd4e882 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:19.386905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:19.388038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.388468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.388995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.389721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:19.393543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:19.573635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1105/2222] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:19 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:19.574845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:19.590598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9ce3e-8c13-4d2a-a57a-f7a792d0a00f admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:19.712736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:19.713374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.713641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.714083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.714919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:19.717016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:19.815533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1118/2223] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:19 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:19.822653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:19.845601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406511f-9bce-4b35-98d7-57b2182d80c9 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:19.860702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:19.861484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.862656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.865290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.866215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:19.868055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:19.898705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1106/2224] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:19.902938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:19.922793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed38167-e951-4090-a2ed-60cff2030c27 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:19.938926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d240d3d-394b-4e53-9fce-65a17d321acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:19.946587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240d3d-394b-4e53-9fce-65a17d321acc admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:19.947209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240d3d-394b-4e53-9fce-65a17d321acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:19.947632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d240d3d-394b-4e53-9fce-65a17d321acc admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:19.948450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d240d3d-394b-4e53-9fce-65a17d321acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:19.954331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d240d3d-394b-4e53-9fce-65a17d321acc admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:20.002003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1119/2225] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:20.010038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:20.027710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5297b2-2ba1-47c6-abb0-08340496230d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:20.037727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:20.038422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:20.038815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:20.039396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] PATH_INFO: `/v3/projects/4c9fe1f04e784e45983c52664d34afef/users/e8b8878d807f4030a5d651e33ac8dc33/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:20.082062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9fe1f04e784e45983c52664d34afef, user_id=e8b8878d807f4030a5d651e33ac8dc33, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:20.085138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:20.175741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:20.191188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1107/2226] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:20 2022] PUT /identity/v3/projects/4c9fe1f04e784e45983c52664d34afef/users/e8b8878d807f4030a5d651e33ac8dc33/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:20.196887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fab7b-22bd-4e04-97d8-a0fe2b7d167b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:20.197267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fab7b-22bd-4e04-97d8-a0fe2b7d167b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:20.197549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fab7b-22bd-4e04-97d8-a0fe2b7d167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:20.253364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2c4fab7b-22bd-4e04-97d8-a0fe2b7d167b None None] MFA Rules not processed for user `e8b8878d807f4030a5d651e33ac8dc33`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:20.254697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2c4fab7b-22bd-4e04-97d8-a0fe2b7d167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:20.417754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1120/2227] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:20.451150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:20.453130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:20.566963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfbd19-7e53-4c78-a221-39a0186574cf admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:20.574722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:20.576732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:20.577249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:20.587014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:20.607579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:20.609349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:20.633700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1108/2228] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:22.266462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815e77-ed4d-4032-b148-f755f3dd7b7d None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:22.267069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815e77-ed4d-4032-b148-f755f3dd7b7d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:22.267257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815e77-ed4d-4032-b148-f755f3dd7b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:22.299744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:22.328500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-52815e77-ed4d-4032-b148-f755f3dd7b7d None None] MFA Rules not processed for user `85c7dc344c8f48989fa9c48d94414fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:22.336494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-52815e77-ed4d-4032-b148-f755f3dd7b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:22.521499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1121/2229] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:22.541357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:22.543386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:22.637076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c1c81-af68-487e-8e52-95a03b9af1d4 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:22.645642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e1919-a648-4d97-8129-9ed17d275eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:22.646656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1919-a648-4d97-8129-9ed17d275eec service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:22.646854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1919-a648-4d97-8129-9ed17d275eec service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:22.647379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1919-a648-4d97-8129-9ed17d275eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:22.650439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bd9e1919-a648-4d97-8129-9ed17d275eec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:22.775256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e1919-a648-4d97-8129-9ed17d275eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:22.779229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e1919-a648-4d97-8129-9ed17d275eec service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:22.796011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1109/2230] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:23.097782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815e77-ed4d-4032-b148-f755f3dd7b7d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.330282 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815e77-ed4d-4032-b148-f755f3dd7b7d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:23.353480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:23.354507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.355104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.355539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] PATH_INFO: `/v3/users/e8b8878d807f4030a5d651e33ac8dc33` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.357286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b8878d807f4030a5d651e33ac8dc33)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:23.359556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:23.605977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b8878d807f4030a5d651e33ac8dc33'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:23.717417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b8878d807f4030a5d651e33ac8dc33'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:23.718299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b8878d807f4030a5d651e33ac8dc33'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:23.740029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b8878d807f4030a5d651e33ac8dc33'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:23.763939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b8878d807f4030a5d651e33ac8dc33'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:23.778788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1122/2231] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:23 2022] DELETE /identity/v3/users/e8b8878d807f4030a5d651e33ac8dc33 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:23.779888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:23.781022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:23.781371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:23.809097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:23.810729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:23.868312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:23.907727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1110/2232] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:23.948889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:23.956777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:24.012786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:24.164021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeb1d9-6251-42c5-b583-832aaf497479 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:24.170036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b185e7-8601-40f5-95ff-86baddaf04fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:24.170888 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b185e7-8601-40f5-95ff-86baddaf04fc service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:24.171536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b185e7-8601-40f5-95ff-86baddaf04fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:24.171957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b185e7-8601-40f5-95ff-86baddaf04fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:24.195542 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b185e7-8601-40f5-95ff-86baddaf04fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:24.198240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b185e7-8601-40f5-95ff-86baddaf04fc service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:24.223371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1123/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:26.378348 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:26.380896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:26.414836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a462a3-cc1a-4e60-a0f2-ed594eb329e0 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:26.432527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:26.433283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:26.434531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:26.434531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] PATH_INFO: `/v3/projects/4c9fe1f04e784e45983c52664d34afef` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:26.438396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9fe1f04e784e45983c52664d34afef)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:26.444791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:26.740766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9fe1f04e784e45983c52664d34afef', 'request_id': 'req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:26.855771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9fe1f04e784e45983c52664d34afef', 'request_id': 'req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:26.864422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9fe1f04e784e45983c52664d34afef', 'request_id': 'req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:26.882560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] The token cache is being invalidate because project 4c9fe1f04e784e45983c52664d34afef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:26.883233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:26.884821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-fb8be5de-852c-4c62-b8d7-62e1d1e64eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:26.890813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1111/2234] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:26 2022] DELETE /identity/v3/projects/4c9fe1f04e784e45983c52664d34afef => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:26.891998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fae00-5892-409c-9b52-12d6be2e94fa None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:26.892486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fae00-5892-409c-9b52-12d6be2e94fa None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:26.892620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fae00-5892-409c-9b52-12d6be2e94fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:26.934923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cc3fae00-5892-409c-9b52-12d6be2e94fa None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:26.936533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cc3fae00-5892-409c-9b52-12d6be2e94fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:27.107843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf5662-7ee9-49d4-abd2-b976452bc877 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:27.107843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf5662-7ee9-49d4-abd2-b976452bc877 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:27.107843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf5662-7ee9-49d4-abd2-b976452bc877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.108489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1124/2235] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:27.135502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a5bf5662-7ee9-49d4-abd2-b976452bc877 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:27.137221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a5bf5662-7ee9-49d4-abd2-b976452bc877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:27.158628 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1112/2236] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:27.165577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fae00-5892-409c-9b52-12d6be2e94fa None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:27.185432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fae00-5892-409c-9b52-12d6be2e94fa None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:27.199748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:27.200391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:27.200671 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:27.201016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.201668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:27.201977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:27.206992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:27.231401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1125/2237] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:27.235866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf5662-7ee9-49d4-abd2-b976452bc877 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:27.249142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf5662-7ee9-49d4-abd2-b976452bc877 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:27.260688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:27.261522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:27.262855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:27.263254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.264063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:27.270161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:27.409543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1113/2238] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:27 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:27.415647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:27.434441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b89ae5-5d28-44ff-97f0-96f7d7395e7a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:27.539032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:27.539032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:27.539032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:27.539032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.539565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:27.543196 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:27.716184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1126/2239] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:27 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:27.720186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:27.737175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3c5fb-f002-4d48-b168-90c745526c67 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:27.751396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:27.752031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:27.752339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:27.752613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.753267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:27.754918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:27.783199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1114/2240] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:27.787988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:27.817335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35f106-8153-49f1-b22d-603626d29f2e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:27.835477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdf761-c50b-4202-8da2-f106c5cb12a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:27.836156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdf761-c50b-4202-8da2-f106c5cb12a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:27.836510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdf761-c50b-4202-8da2-f106c5cb12a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:27.836687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdf761-c50b-4202-8da2-f106c5cb12a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.837744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdf761-c50b-4202-8da2-f106c5cb12a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:27.843515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdf761-c50b-4202-8da2-f106c5cb12a1 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:27.889625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1127/2241] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:27.899503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:27.917318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fd6d5-1ecc-4e0c-9ebd-5fb72e373ba1 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:27.926587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:27.927696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:27.928142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:27.928564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] PATH_INFO: `/v3/projects/0147a36cf1854e1eba47e47194b2d91c/users/2f106618bf1a42229a9ea7bd5a2ede54/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:27.970073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0147a36cf1854e1eba47e47194b2d91c, user_id=2f106618bf1a42229a9ea7bd5a2ede54, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:27.973169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:28.094585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1115/2242] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:27 2022] PUT /identity/v3/projects/0147a36cf1854e1eba47e47194b2d91c/users/2f106618bf1a42229a9ea7bd5a2ede54/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:28.106025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:28.107781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:28.108214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:28.186248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] MFA Rules not processed for user `2f106618bf1a42229a9ea7bd5a2ede54`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:28.190129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:28.201415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:28.331257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1128/2243] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:28.430168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:28.432526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:28.571486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de1c22-6892-4518-ac50-84c7b9456687 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:28.588278 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a9fe6-253f-45eb-ba20-9ed1b69b8a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:28.589210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a9fe6-253f-45eb-ba20-9ed1b69b8a20 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:28.589787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a9fe6-253f-45eb-ba20-9ed1b69b8a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:28.590916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a9fe6-253f-45eb-ba20-9ed1b69b8a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:28.612553 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a9fe6-253f-45eb-ba20-9ed1b69b8a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:28.614372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a9fe6-253f-45eb-ba20-9ed1b69b8a20 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:28.644524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1116/2244] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:32.048058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:32.050064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:32.212375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925c789-637e-49ed-9786-414d3b36a310 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:32.222058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:32.223174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.223854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.230625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] PATH_INFO: `/v3/users/f941f420b18547f7b50353644f294ae8` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.233101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f941f420b18547f7b50353644f294ae8)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:32.240881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:32.578696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f941f420b18547f7b50353644f294ae8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.665511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f941f420b18547f7b50353644f294ae8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.667487 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f941f420b18547f7b50353644f294ae8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.680448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f941f420b18547f7b50353644f294ae8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.727413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f941f420b18547f7b50353644f294ae8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:32.736278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1129/2245] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:32 2022] DELETE /identity/v3/users/f941f420b18547f7b50353644f294ae8 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:32.741471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:32.742027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:32.742027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:32.749288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:32.776624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:32.777863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:32.947724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1117/2246] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:32.969645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:32.971992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:33.072767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:33.165188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53835022-a993-492d-8424-1edab8e906b5 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:33.175966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cbe92-0307-491a-a7f0-f522179fdb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:33.176600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbe92-0307-491a-a7f0-f522179fdb97 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:33.176875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbe92-0307-491a-a7f0-f522179fdb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:33.177141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbe92-0307-491a-a7f0-f522179fdb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:33.199067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cbe92-0307-491a-a7f0-f522179fdb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:33.200742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cbe92-0307-491a-a7f0-f522179fdb97 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:33.226404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1130/2247] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:33.852275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:33.854737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:33.878129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206104b-85a3-477e-afcd-c7a0761f08de None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:33.883699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:33.884706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:33.885459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:33.892229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] PATH_INFO: `/v3/projects/9a1bf00f79d448c7a7912346df6ce673` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:33.892229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1bf00f79d448c7a7912346df6ce673)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:33.892229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:34.071974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1bf00f79d448c7a7912346df6ce673', 'request_id': 'req-f47e9807-2bb8-4384-826a-42d2503531a5'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:34.169220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1bf00f79d448c7a7912346df6ce673', 'request_id': 'req-f47e9807-2bb8-4384-826a-42d2503531a5'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:34.178992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1bf00f79d448c7a7912346df6ce673', 'request_id': 'req-f47e9807-2bb8-4384-826a-42d2503531a5'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:34.195445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] The token cache is being invalidate because project 9a1bf00f79d448c7a7912346df6ce673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:34.195973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:34.197088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f47e9807-2bb8-4384-826a-42d2503531a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:34.199336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1118/2248] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:33 2022] DELETE /identity/v3/projects/9a1bf00f79d448c7a7912346df6ce673 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:34.204685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56363-3930-4990-91ea-31f82fae3111 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:34.206103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56363-3930-4990-91ea-31f82fae3111 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:34.206547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56363-3930-4990-91ea-31f82fae3111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:34.261111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a4d56363-3930-4990-91ea-31f82fae3111 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:34.262360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a4d56363-3930-4990-91ea-31f82fae3111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:34.375836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1131/2249] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:34.378244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84794a-ca43-4c0c-9d33-1cd2867bd36a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:34.378868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84794a-ca43-4c0c-9d33-1cd2867bd36a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:34.379290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84794a-ca43-4c0c-9d33-1cd2867bd36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:34.443923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-bb84794a-ca43-4c0c-9d33-1cd2867bd36a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:34.446845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bb84794a-ca43-4c0c-9d33-1cd2867bd36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:34.461520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1119/2250] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:34.465921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56363-3930-4990-91ea-31f82fae3111 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:34.478181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56363-3930-4990-91ea-31f82fae3111 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:34.483925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:34.484901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:34.485332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:34.485784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:34.486910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:34.487622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:34.489893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:34.512857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1132/2251] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:34.515585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84794a-ca43-4c0c-9d33-1cd2867bd36a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:34.531751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84794a-ca43-4c0c-9d33-1cd2867bd36a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:34.540444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:34.541935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:34.542394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:34.542882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:34.543758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:34.547714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:34.711703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1120/2252] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:34 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:34.715854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:34.731720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfe729-154b-47d9-ba37-3db6a2b79240 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:34.924406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:34.925029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:34.928229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:34.928229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:34.928229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:34.933243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:35.079114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1133/2253] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:34 2022] POST /identity/v3/users => generated 292 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:35.084117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:35.104940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1335fa4-537e-44ab-aab9-821a6a0ea570 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:35.124151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:35.125054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.131752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.131752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.131752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:35.131752 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:35.161001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1121/2254] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:00:35.165558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:35.176945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8b84-6c71-44e2-a9e8-e194a2634eaa admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:35.183183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3eac41-374d-4f55-9084-f610a6f78895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:35.184145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eac41-374d-4f55-9084-f610a6f78895 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.184568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eac41-374d-4f55-9084-f610a6f78895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.185037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eac41-374d-4f55-9084-f610a6f78895 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.185830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3eac41-374d-4f55-9084-f610a6f78895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:35.189183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3eac41-374d-4f55-9084-f610a6f78895 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:35.203611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1134/2255] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:35.209156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:35.223649 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424a6bf-1d7e-4fff-abe9-4a7f50229d6d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:35.231476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:35.232489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.233619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.234853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] PATH_INFO: `/v3/projects/f7e7e92bedfe44dc95098b15e07dfe78/users/96fb63faacad4cf681d843454e18afdc/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.260530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e7e92bedfe44dc95098b15e07dfe78, user_id=96fb63faacad4cf681d843454e18afdc, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:35.265852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:35.883369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1122/2256] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:35 2022] PUT /identity/v3/projects/f7e7e92bedfe44dc95098b15e07dfe78/users/96fb63faacad4cf681d843454e18afdc/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:35.894298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:35.894586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:35.894885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:35.928998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] MFA Rules not processed for user `96fb63faacad4cf681d843454e18afdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:35.930213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:36.031183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:36.206501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1135/2257] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:36.339689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:36.349066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:36.401431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:36.491040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0563e-8779-498b-881b-8b54e3ed9609 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:36.500323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40812046-8fe9-4a9e-a5be-2a06c6a32114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:36.500953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812046-8fe9-4a9e-a5be-2a06c6a32114 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:36.501230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812046-8fe9-4a9e-a5be-2a06c6a32114 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:36.501497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812046-8fe9-4a9e-a5be-2a06c6a32114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:36.521242 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40812046-8fe9-4a9e-a5be-2a06c6a32114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:36.522846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40812046-8fe9-4a9e-a5be-2a06c6a32114 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:36.549225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1123/2258] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:45.228753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:45.230247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:45.334276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96ca41-84e3-4884-8f72-5b13e385e088 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:45.340408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:45.341858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:45.342208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:45.342557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] PATH_INFO: `/v3/users/a776079fbbf44342bea8e8d985f3abbe` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:45.344056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a776079fbbf44342bea8e8d985f3abbe)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:45.347032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:45.779862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a776079fbbf44342bea8e8d985f3abbe'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:45.888720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a776079fbbf44342bea8e8d985f3abbe'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:45.889272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a776079fbbf44342bea8e8d985f3abbe'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:45.899540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a776079fbbf44342bea8e8d985f3abbe'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:45.963928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a776079fbbf44342bea8e8d985f3abbe'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:45.991426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1136/2259] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:45 2022] DELETE /identity/v3/users/a776079fbbf44342bea8e8d985f3abbe => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:45.995981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:45.996566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:46.002325 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:46.062955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:46.068137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:46.280818 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1124/2260] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:46.341578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:46.341578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:46.516830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:46.529961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe7f5-37ef-46a3-8322-df3e56589a4e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:46.535477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab94831-332c-4d07-a08d-4afb6dbca116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:46.536873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94831-332c-4d07-a08d-4afb6dbca116 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:46.537147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94831-332c-4d07-a08d-4afb6dbca116 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:46.537588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94831-332c-4d07-a08d-4afb6dbca116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:46.564429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab94831-332c-4d07-a08d-4afb6dbca116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:46.567512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab94831-332c-4d07-a08d-4afb6dbca116 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:46.622014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1137/2261] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:48.002229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:48.003864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:48.026143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b8a8-d06d-4f9e-a348-da4490bd65da None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:48.052986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:48.053855 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:48.054248 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:48.054704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] PATH_INFO: `/v3/projects/7c6d100b442847c8a0564fd14e5a2e4f` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:48.056176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6d100b442847c8a0564fd14e5a2e4f)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:48.058931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:48.256487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6d100b442847c8a0564fd14e5a2e4f', 'request_id': 'req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:48.371190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6d100b442847c8a0564fd14e5a2e4f', 'request_id': 'req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:48.379686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6d100b442847c8a0564fd14e5a2e4f', 'request_id': 'req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:48.415064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] The token cache is being invalidate because project 7c6d100b442847c8a0564fd14e5a2e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:48.422633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:48.422633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bca34ac-bac0-4cc5-b448-b4dcf5f2d455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:48.422633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1125/2262] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:48 2022] DELETE /identity/v3/projects/7c6d100b442847c8a0564fd14e5a2e4f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:48.425319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcb0d-e2cc-47e7-af86-c236ab5d2cc7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:48.425821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcb0d-e2cc-47e7-af86-c236ab5d2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:48.425903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfcb0d-e2cc-47e7-af86-c236ab5d2cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:48.483065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-dbbfcb0d-e2cc-47e7-af86-c236ab5d2cc7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:48.487083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dbbfcb0d-e2cc-47e7-af86-c236ab5d2cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:48.684811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1138/2263] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:48.694350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d8f6-f50a-40e2-980c-a4d6cb0f3674 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:48.694350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d8f6-f50a-40e2-980c-a4d6cb0f3674 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:48.694350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d8f6-f50a-40e2-980c-a4d6cb0f3674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:48.733678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ba74d8f6-f50a-40e2-980c-a4d6cb0f3674 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:48.735920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ba74d8f6-f50a-40e2-980c-a4d6cb0f3674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:48.750722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1126/2264] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:00:48.754637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfcb0d-e2cc-47e7-af86-c236ab5d2cc7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:48.778692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfcb0d-e2cc-47e7-af86-c236ab5d2cc7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:48.791668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:48.794155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:48.798063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:48.798063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:48.798063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:00:48.798063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:48.798063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:48.827829 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1139/2265] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:00:48.840340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74d8f6-f50a-40e2-980c-a4d6cb0f3674 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:48.851999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74d8f6-f50a-40e2-980c-a4d6cb0f3674 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:48.876302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:48.876302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:48.876302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:48.876302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:48.877493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:48.880737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:49.065658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1127/2266] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:00:48 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:49.069749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:49.098548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e0113-7560-4e49-b746-cd7beb6c00aa admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:49.257053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:49.257738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:49.263478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:49.263872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:49.265127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:49.271599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:49.376262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1140/2267] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:00:49 2022] POST /identity/v3/users => generated 288 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:00:49.377598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:49.392377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f920643-15f2-4787-ab50-2f84a3941ed8 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:49.406496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:49.407166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:49.407445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:49.409667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:49.409667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:49.411089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:49.428078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1128/2268] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:49.432024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:49.449716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ee29-a839-426f-97c1-e372946e8eee admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:49.458548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627f9d0-d503-4e18-8174-f20a40601a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:49.460082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f9d0-d503-4e18-8174-f20a40601a2e admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:49.460368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f9d0-d503-4e18-8174-f20a40601a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:49.460641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f9d0-d503-4e18-8174-f20a40601a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:49.461314 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627f9d0-d503-4e18-8174-f20a40601a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:49.464783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627f9d0-d503-4e18-8174-f20a40601a2e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:49.481764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1141/2269] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:00:49.485741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:49.509099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dfc09-d396-419d-94a4-8357233e56d6 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:49.522414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:49.522414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:49.522414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:49.522414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] PATH_INFO: `/v3/projects/bfe8f0fde7334e928ebb8e123ad69a89/users/38c8a8915556427bb453a1ee114e80cc/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:49.526452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:49.548913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe8f0fde7334e928ebb8e123ad69a89, user_id=38c8a8915556427bb453a1ee114e80cc, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:49.553837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:49.645888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1129/2270] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:00:49 2022] PUT /identity/v3/projects/bfe8f0fde7334e928ebb8e123ad69a89/users/38c8a8915556427bb453a1ee114e80cc/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:49.657947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a15bb-7d7a-458f-8e47-a8d247946033 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:49.658648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a15bb-7d7a-458f-8e47-a8d247946033 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:49.659031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a15bb-7d7a-458f-8e47-a8d247946033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:49.698411 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f05a15bb-7d7a-458f-8e47-a8d247946033 None None] MFA Rules not processed for user `38c8a8915556427bb453a1ee114e80cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:49.699932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f05a15bb-7d7a-458f-8e47-a8d247946033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:49.795878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:49.856977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1142/2271] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:49.888859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:49.891496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:49.992224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0c1d9-dd96-47a4-b03d-b0af248baffa admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:49.997097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06b6c7-1b13-445b-97e4-270e3a5943cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:49.998197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06b6c7-1b13-445b-97e4-270e3a5943cf service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:49.998653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06b6c7-1b13-445b-97e4-270e3a5943cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:49.999139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06b6c7-1b13-445b-97e4-270e3a5943cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:50.016254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06b6c7-1b13-445b-97e4-270e3a5943cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:50.017780 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06b6c7-1b13-445b-97e4-270e3a5943cf service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:50.054851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1130/2272] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:50.093664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a15bb-7d7a-458f-8e47-a8d247946033 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:50.288808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a15bb-7d7a-458f-8e47-a8d247946033 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:50.298594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:50.301684 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:50.313322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:50.313322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] PATH_INFO: `/v3/users/38c8a8915556427bb453a1ee114e80cc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:50.313322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c8a8915556427bb453a1ee114e80cc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:50.313322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:50.689185 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c8a8915556427bb453a1ee114e80cc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:50.809008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c8a8915556427bb453a1ee114e80cc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:50.810230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c8a8915556427bb453a1ee114e80cc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:50.824410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c8a8915556427bb453a1ee114e80cc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:50.859855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c8a8915556427bb453a1ee114e80cc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:50.888280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1143/2273] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:00:50 2022] DELETE /identity/v3/users/38c8a8915556427bb453a1ee114e80cc => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:00:50.894437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:50.897166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:50.897544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:50.925739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:00:50.928799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:51.052198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1131/2274] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:00:51.139815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:51.141597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:51.328392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03e727-79ed-4fc1-ab5e-664c51b5f286 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:51.346508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:51.360870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:51.361158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:51.361435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:51.389049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:51.390799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:51.441129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1144/2275] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:54.187224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:00:54.189045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:00:54.213590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5050-3f79-4d1c-93ae-dc5e61cf0f91 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:00:54.228798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:00:54.229455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:00:54.229726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:00:54.230184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] PATH_INFO: `/v3/projects/bfe8f0fde7334e928ebb8e123ad69a89` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:00:54.232174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe8f0fde7334e928ebb8e123ad69a89)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:00:54.234356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:00:54.412660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe8f0fde7334e928ebb8e123ad69a89', 'request_id': 'req-02f82ad5-29f5-4493-aef6-8771004bb3ed'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:54.486423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe8f0fde7334e928ebb8e123ad69a89', 'request_id': 'req-02f82ad5-29f5-4493-aef6-8771004bb3ed'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:54.494916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe8f0fde7334e928ebb8e123ad69a89', 'request_id': 'req-02f82ad5-29f5-4493-aef6-8771004bb3ed'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:54.527037 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] The token cache is being invalidate because project bfe8f0fde7334e928ebb8e123ad69a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:00:54.527316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:54.528820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-02f82ad5-29f5-4493-aef6-8771004bb3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:00:54.535410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1132/2276] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:54 2022] DELETE /identity/v3/projects/bfe8f0fde7334e928ebb8e123ad69a89 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:01.426385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:04.511295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:08.595157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:08.597620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:08.617041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b736046-0eed-4709-a7a2-00681d79b506 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:08.753177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:08.760060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:08.760060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:08.760060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] PATH_INFO: `/v3/users/96fb63faacad4cf681d843454e18afdc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:08.760060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fb63faacad4cf681d843454e18afdc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:08.760060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:09.108497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fb63faacad4cf681d843454e18afdc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:09.216649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fb63faacad4cf681d843454e18afdc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:09.218515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fb63faacad4cf681d843454e18afdc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:09.228271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fb63faacad4cf681d843454e18afdc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:09.260588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fb63faacad4cf681d843454e18afdc'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:09.301032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1145/2277] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:08 2022] DELETE /identity/v3/users/96fb63faacad4cf681d843454e18afdc => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:09.305437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:09.306396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:09.306861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:09.344998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:09.347428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:09.353316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:09.354813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:09.502246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1133/2278] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:09.514008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:09.515984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:09.517274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48210a-3a47-4f6b-8fa6-0ab824765f15 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:09.522372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:09.523243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:09.523528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:09.523837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] PATH_INFO: `/v3/users/2f106618bf1a42229a9ea7bd5a2ede54` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:09.525125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f106618bf1a42229a9ea7bd5a2ede54)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:09.527202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:09.556964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:09.631861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7cf6a-bdcc-456b-8580-0bbbdb398d19 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:09.636761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:09.637715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:09.638192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:09.638689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:09.652310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:09.653970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:09.669952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1134/2279] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:09.790084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:09.791853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:09.819751 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f106618bf1a42229a9ea7bd5a2ede54'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:09.821821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b055ff-4a4b-4548-a22c-35d45f7c52d8 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:09.845174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:09.845885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:09.846204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:09.846468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] PATH_INFO: `/v3/users/edd8f385fe1c4170b92148450e17d6a3` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:09.848053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd8f385fe1c4170b92148450e17d6a3)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:09.852620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:09.998721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f106618bf1a42229a9ea7bd5a2ede54'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:09.999624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f106618bf1a42229a9ea7bd5a2ede54'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.009119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f106618bf1a42229a9ea7bd5a2ede54'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.034651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f0a84012-d736-4ec7-aac5-d1953b469b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f106618bf1a42229a9ea7bd5a2ede54'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.043512 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1146/2280] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:09 2022] DELETE /identity/v3/users/2f106618bf1a42229a9ea7bd5a2ede54 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:10.052398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:10.052398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:10.052398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:10.084375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:10.085694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:10.207742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1147/2281] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:10.211509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd8f385fe1c4170b92148450e17d6a3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.228602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:10.230600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:10.328733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebd827-164b-4ca0-bb4a-9bca62a33b94 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:10.334174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:10.334739 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:10.335027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:10.335595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:10.351788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:10.353435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:10.360200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd8f385fe1c4170b92148450e17d6a3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.386902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1148/2282] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:10.388340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:10.389977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:10.390737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd8f385fe1c4170b92148450e17d6a3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.394713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd8f385fe1c4170b92148450e17d6a3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.412204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-589282ba-cc3f-494a-8d20-65fe6530229b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd8f385fe1c4170b92148450e17d6a3'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.423410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1138c-ca4f-4448-b684-e441d9dbcd31 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:10.430115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:10.431268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:10.434526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1135/2283] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:09 2022] DELETE /identity/v3/users/edd8f385fe1c4170b92148450e17d6a3 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:01:10.434901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:10.434901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] PATH_INFO: `/v3/projects/f7e7e92bedfe44dc95098b15e07dfe78` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:10.436166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:10.436304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e7e92bedfe44dc95098b15e07dfe78)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:10.436444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:10.436900 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:10.440954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:10.483353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:10.492346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:10.511602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:10.615645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e7e92bedfe44dc95098b15e07dfe78', 'request_id': 'req-8f390c15-9ea0-4f7c-a070-3c705e178b6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.636062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1136/2284] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:10.666041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:10.668098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:10.780432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d01e7-8a19-406a-ad17-903443420b24 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:10.792390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e7e92bedfe44dc95098b15e07dfe78', 'request_id': 'req-8f390c15-9ea0-4f7c-a070-3c705e178b6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.815958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e7e92bedfe44dc95098b15e07dfe78', 'request_id': 'req-8f390c15-9ea0-4f7c-a070-3c705e178b6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.853308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] The token cache is being invalidate because project f7e7e92bedfe44dc95098b15e07dfe78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:10.856360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.860892 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-8f390c15-9ea0-4f7c-a070-3c705e178b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:10.864451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1149/2285] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:10 2022] DELETE /identity/v3/projects/f7e7e92bedfe44dc95098b15e07dfe78 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:10.878324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:10.878601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:10.878964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:10.933934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:10.941546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:10.942404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c4d98-8664-443d-b976-0243ac00075f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:10.943097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4d98-8664-443d-b976-0243ac00075f service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:10.943333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4d98-8664-443d-b976-0243ac00075f service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:10.943597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4d98-8664-443d-b976-0243ac00075f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:10.948333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bd4c4d98-8664-443d-b976-0243ac00075f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:11.084917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1150/2286] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:11.087536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:11.089083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:11.107680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9fe4b-f446-45e7-aceb-8ab41299a2f6 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:11.124364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:11.125168 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.125772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.126124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] PATH_INFO: `/v3/projects/0147a36cf1854e1eba47e47194b2d91c` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.127068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c4d98-8664-443d-b976-0243ac00075f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:11.127961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0147a36cf1854e1eba47e47194b2d91c)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:11.129646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c4d98-8664-443d-b976-0243ac00075f service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:11.130064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:11.150183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1137/2287] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:11.151786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41019041-8db8-48a2-aa5d-4a9aab876189 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.154973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41019041-8db8-48a2-aa5d-4a9aab876189 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.156437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41019041-8db8-48a2-aa5d-4a9aab876189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.205174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-41019041-8db8-48a2-aa5d-4a9aab876189 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:11.206597 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-41019041-8db8-48a2-aa5d-4a9aab876189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:11.220594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1138/2288] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:11.224798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41019041-8db8-48a2-aa5d-4a9aab876189 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:11.234372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41019041-8db8-48a2-aa5d-4a9aab876189 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:11.240723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:11.241926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.242225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.242507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.243238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:11.243549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:11.245194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:11.265667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1139/2289] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:11.266746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:11.280541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd2af0-1045-4470-9b69-dbd2a807e455 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:11.287015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:11.287954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.288430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.288860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.289685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:11.292085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:11.381678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0147a36cf1854e1eba47e47194b2d91c', 'request_id': 'req-45beb639-2b7a-439d-b3c1-ae710ea08b0b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:11.448153 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0147a36cf1854e1eba47e47194b2d91c', 'request_id': 'req-45beb639-2b7a-439d-b3c1-ae710ea08b0b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:11.468457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1140/2290] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:11 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:11.471730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:11.479509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0147a36cf1854e1eba47e47194b2d91c', 'request_id': 'req-45beb639-2b7a-439d-b3c1-ae710ea08b0b'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:11.480357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:11.515613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] The token cache is being invalidate because project 0147a36cf1854e1eba47e47194b2d91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:11.517156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:11.519992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:11.521858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1151/2291] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:11 2022] DELETE /identity/v3/projects/0147a36cf1854e1eba47e47194b2d91c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:11.559489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:11.563643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:11.669579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231725d-442b-430f-a88f-f2725ccc5eb2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:11.677537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:11.678471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.680475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.680475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] PATH_INFO: `/v3/users/8c29a86ed0ba45c18666b029b259708c` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.682158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c29a86ed0ba45c18666b029b259708c)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:11.684893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:11.711756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb639-2b7a-439d-b3c1-ae710ea08b0b admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:11.717260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f7f2-25ad-4875-b5ea-ed34e8ca0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:11.718053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f7f2-25ad-4875-b5ea-ed34e8ca0429 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.718339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f7f2-25ad-4875-b5ea-ed34e8ca0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.718615 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f7f2-25ad-4875-b5ea-ed34e8ca0429 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.719317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f7f2-25ad-4875-b5ea-ed34e8ca0429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:11.721959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f7f2-25ad-4875-b5ea-ed34e8ca0429 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:11.853968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:11.866625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1152/2292] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:11 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:11.866625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.866625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.866625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.899166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:11.900921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:11.924946 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1153/2293] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:11.927179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:11.929626 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:11.966062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c419c-9cb3-44d5-9f33-9576dbfb0295 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:11.982381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:11.983987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:11.984538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:11.985028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] PATH_INFO: `/v3/projects/957c4481f9b648aea145c14784aee8dc` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:11.989566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=957c4481f9b648aea145c14784aee8dc)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:11.992680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.056118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c29a86ed0ba45c18666b029b259708c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.205558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c29a86ed0ba45c18666b029b259708c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.225257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c29a86ed0ba45c18666b029b259708c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.226852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c29a86ed0ba45c18666b029b259708c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.240137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957c4481f9b648aea145c14784aee8dc', 'request_id': 'req-ea6881d3-a95d-41a7-be16-d39d981c5553'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.240637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c29a86ed0ba45c18666b029b259708c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.254302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1141/2294] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:11 2022] DELETE /identity/v3/users/8c29a86ed0ba45c18666b029b259708c => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:12.255825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:12.258132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:12.368978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2edc61-35a9-4ab2-a7d6-788e7718e8d4 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:12.375748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5d610-4103-4c2c-97ea-f0c95c1c6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:12.376375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5d610-4103-4c2c-97ea-f0c95c1c6911 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.376654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5d610-4103-4c2c-97ea-f0c95c1c6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.376932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5d610-4103-4c2c-97ea-f0c95c1c6911 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.377849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5d610-4103-4c2c-97ea-f0c95c1c6911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:12.379717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5d610-4103-4c2c-97ea-f0c95c1c6911 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.386255 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957c4481f9b648aea145c14784aee8dc', 'request_id': 'req-ea6881d3-a95d-41a7-be16-d39d981c5553'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.395837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1142/2295] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:12.396471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.396750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.398539 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.399524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957c4481f9b648aea145c14784aee8dc', 'request_id': 'req-ea6881d3-a95d-41a7-be16-d39d981c5553'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.426768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] The token cache is being invalidate because project 957c4481f9b648aea145c14784aee8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:12.427085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.428019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ea6881d3-a95d-41a7-be16-d39d981c5553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:12.428159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:12.429469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:12.447075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1154/2296] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:11 2022] DELETE /identity/v3/projects/957c4481f9b648aea145c14784aee8dc => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:12.448933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e1f39-45c7-403a-80bc-5008f1c286aa None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.449418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e1f39-45c7-403a-80bc-5008f1c286aa None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.449931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e1f39-45c7-403a-80bc-5008f1c286aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.490523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1143/2297] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:12.491631 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:12.493418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:12.510967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ea2e1f39-45c7-403a-80bc-5008f1c286aa None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:12.513029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ea2e1f39-45c7-403a-80bc-5008f1c286aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:12.519083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b51aee-b69a-4561-b620-ff89c3d35f08 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:12.538579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:12.539762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.540446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.542130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.545996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:12.551045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.554169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1155/2298] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:12.554169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e1f39-45c7-403a-80bc-5008f1c286aa None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:12.570354 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e1f39-45c7-403a-80bc-5008f1c286aa None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:12.592119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1144/2299] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:12.592119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:12.601352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:12.630148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:12.633041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.634300 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.637212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.639581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:12.641507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:12.646350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.696098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1156/2300] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:12.697127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:12.719592 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f163cd-9679-42b6-a34c-e171b8a22e01 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:12.741876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364d76d-d7d5-4984-b511-498eb0f70af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:12.742605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364d76d-d7d5-4984-b511-498eb0f70af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.742913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364d76d-d7d5-4984-b511-498eb0f70af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.743193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364d76d-d7d5-4984-b511-498eb0f70af0 admin admin] PATH_INFO: `/v3/projects/d3ab0910f0244c4e97a71827fa47d8b0/users/4324ac5b629f45caa1a81bfddc0c03f6/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.776278 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7890-4904-4911-96b1-500bfe1321e5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:12.795954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:12.796587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.796920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.797134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.798947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364d76d-d7d5-4984-b511-498eb0f70af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ab0910f0244c4e97a71827fa47d8b0, user_id=4324ac5b629f45caa1a81bfddc0c03f6, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:12.801731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364d76d-d7d5-4984-b511-498eb0f70af0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.813988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:12.817076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.829354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1145/2301] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:12.830224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:12.843814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd760d-66fe-4e16-ac7c-7ba09ea0872d service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:12.849327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:12.850244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.850713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.851130 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:12.853753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:12.854161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:12.937686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1157/2302] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:12 2022] PUT /identity/v3/projects/d3ab0910f0244c4e97a71827fa47d8b0/users/4324ac5b629f45caa1a81bfddc0c03f6/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:12.961078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b71132-04ff-47b8-ba7b-044c4ad89498 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:12.963066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b71132-04ff-47b8-ba7b-044c4ad89498 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:12.963635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b71132-04ff-47b8-ba7b-044c4ad89498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.014722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-02b71132-04ff-47b8-ba7b-044c4ad89498 None None] MFA Rules not processed for user `4324ac5b629f45caa1a81bfddc0c03f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:13.016471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-02b71132-04ff-47b8-ba7b-044c4ad89498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:13.040463 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1146/2303] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:12 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:13.042133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:13.143635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:13.153103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1158/2304] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:13.160841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b71132-04ff-47b8-ba7b-044c4ad89498 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:13.165906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bdb6b-07d0-47c7-801e-1025474a85ab admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:13.175828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:13.176304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:13.176821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:13.177104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.177760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:13.179910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:13.287332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b71132-04ff-47b8-ba7b-044c4ad89498 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:13.351693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1147/2305] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:13 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:13.357788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:13.366469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:13.367281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:13.367560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:13.367825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.371860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263695c4-6e17-465a-95b8-9b6e8c2eebab admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:13.379990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:13.380778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:13.381121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:13.381705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.382843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:13.384680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:13.400010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1148/2306] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:13.404411 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:13.417509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb181cae-456a-4212-89d1-4a68924c06f8 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:13.423373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:13.424002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:13.425055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:13.425361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.426299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:13.429324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:13.445303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1149/2307] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:13.450190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:13.461753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:13.464007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:13.464377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc19fcd-7f43-4b76-b643-7138ecedf001 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:13.471188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaaa5b-43ec-48e2-a3b7-79f01a5b1c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:13.480760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaaa5b-43ec-48e2-a3b7-79f01a5b1c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:13.480760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaaa5b-43ec-48e2-a3b7-79f01a5b1c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:13.480760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaaa5b-43ec-48e2-a3b7-79f01a5b1c09 admin admin] PATH_INFO: `/v3/projects/c062133972ff4ef587a62c49af30ec1c/users/6786216b35fd420fb608b783efcc0c79/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.493316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1159/2308] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:13.508237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaaa5b-43ec-48e2-a3b7-79f01a5b1c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c062133972ff4ef587a62c49af30ec1c, user_id=6786216b35fd420fb608b783efcc0c79, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:13.512101 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaaa5b-43ec-48e2-a3b7-79f01a5b1c09 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:13.591884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:13.597437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:13.633215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343bfc0-064d-4260-92c7-4245b2f363cf service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:13.638966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:13.639863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:13.640319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:13.640844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] PATH_INFO: `/v3/projects/25a1ece53cc94768b28900845d6f215a` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.642637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a1ece53cc94768b28900845d6f215a)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:13.646129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:13.648437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1150/2309] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:13 2022] PUT /identity/v3/projects/c062133972ff4ef587a62c49af30ec1c/users/6786216b35fd420fb608b783efcc0c79/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:13.665684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f076-fe53-4e07-b485-aee1ce578777 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:13.666111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f076-fe53-4e07-b485-aee1ce578777 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:13.666728 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387f076-fe53-4e07-b485-aee1ce578777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:13.751732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6387f076-fe53-4e07-b485-aee1ce578777 None None] MFA Rules not processed for user `6786216b35fd420fb608b783efcc0c79`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:13.754432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6387f076-fe53-4e07-b485-aee1ce578777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:13.797023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a1ece53cc94768b28900845d6f215a', 'request_id': 'req-4d2c9e72-68ff-4e47-bf22-97f664bbb701'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:13.874858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1151/2310] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:13.896078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387f076-fe53-4e07-b485-aee1ce578777 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:13.952414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a1ece53cc94768b28900845d6f215a', 'request_id': 'req-4d2c9e72-68ff-4e47-bf22-97f664bbb701'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:13.961280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a1ece53cc94768b28900845d6f215a', 'request_id': 'req-4d2c9e72-68ff-4e47-bf22-97f664bbb701'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:13.989714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] The token cache is being invalidate because project 25a1ece53cc94768b28900845d6f215a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:13.990996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:13.994520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387f076-fe53-4e07-b485-aee1ce578777 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:13.995764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d2c9e72-68ff-4e47-bf22-97f664bbb701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:13.997534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1160/2311] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:13 2022] DELETE /identity/v3/projects/25a1ece53cc94768b28900845d6f215a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:14.003281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998adf7-6745-4e31-90c9-eb560090acdc None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.003281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998adf7-6745-4e31-90c9-eb560090acdc None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.003523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998adf7-6745-4e31-90c9-eb560090acdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.042730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d998adf7-6745-4e31-90c9-eb560090acdc None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:14.059590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d998adf7-6745-4e31-90c9-eb560090acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.078125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4166c4e-be44-4b9b-b535-f73280086b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.078786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166c4e-be44-4b9b-b535-f73280086b1a service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.079067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166c4e-be44-4b9b-b535-f73280086b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.079337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166c4e-be44-4b9b-b535-f73280086b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.081991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a4166c4e-be44-4b9b-b535-f73280086b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.145821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:14.182252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4166c4e-be44-4b9b-b535-f73280086b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.184093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4166c4e-be44-4b9b-b535-f73280086b1a service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.204906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1152/2312] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:14.219021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1161/2313] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:01:14.230594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c56638-294c-486d-99fc-0ac596848f02 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.231032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c56638-294c-486d-99fc-0ac596848f02 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.233381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c56638-294c-486d-99fc-0ac596848f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.288422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f2c56638-294c-486d-99fc-0ac596848f02 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:14.289971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f2c56638-294c-486d-99fc-0ac596848f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.313904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1153/2314] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:14.315380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998adf7-6745-4e31-90c9-eb560090acdc None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.331792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998adf7-6745-4e31-90c9-eb560090acdc None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.346969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.347611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.347904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.348234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.348957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:14.349210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.351754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.374035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1162/2315] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:01:14.375314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c56638-294c-486d-99fc-0ac596848f02 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.388842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c56638-294c-486d-99fc-0ac596848f02 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.400647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.400647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.400647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.400647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.401693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.402400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.525707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1154/2316] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:14 2022] POST /identity/v3/projects => generated 359 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:01:14.528271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.555675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac100c-3a36-4328-9611-ac0b5ef13226 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.694293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.695053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.695358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.695653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.699053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.699053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.799406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1163/2317] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:14 2022] POST /identity/v3/users => generated 280 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:14.803720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.821902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaf942-8411-47df-833d-bb3223b1e79c admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.837685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.838346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.838627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.838926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.839795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.841839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.874757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.877712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:14.884923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1155/2318] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:14.889775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.901087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884ab57-ddec-401a-bd06-66891fa3d990 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.903418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.904337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.904686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.905247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] PATH_INFO: `/v3/users/4324ac5b629f45caa1a81bfddc0c03f6` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.913691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7d10f-eccf-4916-8674-9174f5a1ec4a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.915241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4324ac5b629f45caa1a81bfddc0c03f6)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.921086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.921730 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.921894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.922061 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.922327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.923069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.924922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:14.943582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1156/2319] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:14.952068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:14.969954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f3fb5-1284-4804-98a6-35de05810647 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:14.976498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73fbc3-8e49-4cd7-9661-44b68d11c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:14.977172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fbc3-8e49-4cd7-9661-44b68d11c4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:14.977451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fbc3-8e49-4cd7-9661-44b68d11c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:14.977718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fbc3-8e49-4cd7-9661-44b68d11c4d0 admin admin] PATH_INFO: `/v3/projects/fddfa3106a1c43cb8e4691153b6cbfc9/users/d82135271d994cc5b3930fd6d97a6657/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:14.995759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73fbc3-8e49-4cd7-9661-44b68d11c4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddfa3106a1c43cb8e4691153b6cbfc9, user_id=d82135271d994cc5b3930fd6d97a6657, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:14.998078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73fbc3-8e49-4cd7-9661-44b68d11c4d0 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:15.153070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1157/2320] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:14 2022] PUT /identity/v3/projects/fddfa3106a1c43cb8e4691153b6cbfc9/users/d82135271d994cc5b3930fd6d97a6657/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:15.164261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:15.164544 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:15.164847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:15.174837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:15.195949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4324ac5b629f45caa1a81bfddc0c03f6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.223961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] MFA Rules not processed for user `d82135271d994cc5b3930fd6d97a6657`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:15.225776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.338500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1158/2321] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:15.346955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:15.348470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.353565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4324ac5b629f45caa1a81bfddc0c03f6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.356659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4324ac5b629f45caa1a81bfddc0c03f6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.363941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4324ac5b629f45caa1a81bfddc0c03f6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.379780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-afc9803f-d8a6-498f-a678-3aaefc7bd208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4324ac5b629f45caa1a81bfddc0c03f6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:15.388071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1164/2322] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:14 2022] DELETE /identity/v3/users/4324ac5b629f45caa1a81bfddc0c03f6 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:15.392926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:15.393480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:15.393933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:15.422470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc75e0-f3d5-4447-aea5-ed8074467ca0 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:15.423445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:15.425269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.506590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bbff1-3409-432c-97f6-e2d9949ebd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:15.507361 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bbff1-3409-432c-97f6-e2d9949ebd5c service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:15.507864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bbff1-3409-432c-97f6-e2d9949ebd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:15.508301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bbff1-3409-432c-97f6-e2d9949ebd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:15.511505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3d9bbff1-3409-432c-97f6-e2d9949ebd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.557614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1165/2323] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:15.565555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:15.567112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:15.581465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e788d7-e86a-4267-9042-e1253c5fdc77 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:15.586339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:15.587050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:15.587348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:15.587596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:15.600969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:15.601188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bbff1-3409-432c-97f6-e2d9949ebd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:15.602658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bbff1-3409-432c-97f6-e2d9949ebd5c service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:15.604197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:15.621028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1166/2324] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:15.621241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1159/2325] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:16.560845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:16.563120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:16.582899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55bf0c-70bf-4b1d-869a-e06160dde941 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:16.588467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:16.589374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:16.589813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:16.590268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] PATH_INFO: `/v3/projects/d3ab0910f0244c4e97a71827fa47d8b0` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:16.591815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ab0910f0244c4e97a71827fa47d8b0)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:16.594116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:16.826155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ab0910f0244c4e97a71827fa47d8b0', 'request_id': 'req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.984173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ab0910f0244c4e97a71827fa47d8b0', 'request_id': 'req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:16.992318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ab0910f0244c4e97a71827fa47d8b0', 'request_id': 'req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.006608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] The token cache is being invalidate because project d3ab0910f0244c4e97a71827fa47d8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:17.007174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.007905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ce6acf2c-619d-4bf1-bf70-09119bd5d0f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:17.009688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1167/2326] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:16 2022] DELETE /identity/v3/projects/d3ab0910f0244c4e97a71827fa47d8b0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:01:17.014844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36afc1-2c73-46a2-b02a-64dbaad3d94e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.015379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36afc1-2c73-46a2-b02a-64dbaad3d94e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.015534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36afc1-2c73-46a2-b02a-64dbaad3d94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.049985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1a36afc1-2c73-46a2-b02a-64dbaad3d94e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:17.053713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1a36afc1-2c73-46a2-b02a-64dbaad3d94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:17.168788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1160/2327] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:17.177022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5689add-a49a-430b-9304-519d0ccf026f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.177677 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5689add-a49a-430b-9304-519d0ccf026f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.178106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5689add-a49a-430b-9304-519d0ccf026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.225285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d5689add-a49a-430b-9304-519d0ccf026f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:17.226524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d5689add-a49a-430b-9304-519d0ccf026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:17.240588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1168/2328] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:17.245191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36afc1-2c73-46a2-b02a-64dbaad3d94e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.255514 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36afc1-2c73-46a2-b02a-64dbaad3d94e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.266096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.266877 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.267156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.267421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.270534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:17.271043 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.273121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.311552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5689add-a49a-430b-9304-519d0ccf026f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.312565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1161/2329] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:17.325597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5689add-a49a-430b-9304-519d0ccf026f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.338328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.343456 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.350063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.350063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.350063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.350063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.498638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1169/2330] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:17 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:01:17.503867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.521639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c09a-df45-424d-9584-d488d3d35352 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.612014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.612014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.612014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.612014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.612407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.613595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.828198 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1162/2331] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:17 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:17.834716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.851210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:17.866399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6f6c4-3658-452a-9f78-eb251a8be1c5 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.879773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.881531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.882235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.883055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.885645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.890010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:17.925223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1170/2332] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:17.928275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:17.964240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bba29-bc64-4d34-82ca-9498b31bf84f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:17.984920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1c144-bbaa-4619-b5a2-069505b59889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:17.985775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1c144-bbaa-4619-b5a2-069505b59889 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:17.986244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1c144-bbaa-4619-b5a2-069505b59889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:17.987255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1c144-bbaa-4619-b5a2-069505b59889 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:17.988337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1c144-bbaa-4619-b5a2-069505b59889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:17.991571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1c144-bbaa-4619-b5a2-069505b59889 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.017368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1163/2333] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:18.018781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.034095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd9a68-4472-4f29-816c-4d90fa6224bc admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.040324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.041144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.041547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.042021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] PATH_INFO: `/v3/projects/0d399d550dab41259d95623249c98b71/users/0949a6af053443818fdac57ad82e81b0/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.066253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d399d550dab41259d95623249c98b71, user_id=0949a6af053443818fdac57ad82e81b0, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.069368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.204182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1171/2334] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:18 2022] PUT /identity/v3/projects/0d399d550dab41259d95623249c98b71/users/0949a6af053443818fdac57ad82e81b0/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:01:18.215998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b729eb-7990-4873-a8ba-7defd4357559 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.216263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b729eb-7990-4873-a8ba-7defd4357559 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.216715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b729eb-7990-4873-a8ba-7defd4357559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.269903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-37b729eb-7990-4873-a8ba-7defd4357559 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:18.271611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-37b729eb-7990-4873-a8ba-7defd4357559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:18.371918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1164/2335] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:18.372993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.468115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578744e-1699-4ba8-af7a-6d3940c3942b admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.474593 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.475833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.476676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.477043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.477535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.480471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.665938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1172/2336] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:01:18.670703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b729eb-7990-4873-a8ba-7defd4357559 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.689041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b729eb-7990-4873-a8ba-7defd4357559 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.798316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.801409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.801409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.802173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.803430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:18.805556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:18.853313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:18.958251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1165/2337] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:18 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:18.962656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:18.984612 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60738e5-6ded-42b6-8373-48bac09e7cb6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:18.993568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:18.994909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:18.995614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:18.996053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:18.997479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.000192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.019844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1173/2338] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:19.025232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.038070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060ade8-5d4b-4448-9c48-fd2fc268694c admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.044595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.045374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.045753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.046031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] PATH_INFO: `/v3/projects/6bae85ff2f97408eb7f162001b44a5a8/users/7c5f46201fa14176ba942f182245be9b/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.085543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bae85ff2f97408eb7f162001b44a5a8, user_id=7c5f46201fa14176ba942f182245be9b, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.094658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.187975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1166/2339] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:19 2022] PUT /identity/v3/projects/6bae85ff2f97408eb7f162001b44a5a8/users/7c5f46201fa14176ba942f182245be9b/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:19.192506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.210879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ad71-992e-4d18-9053-b9b5d41ae662 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.288660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056f49b-64ae-436e-b2b5-fed3e40b08ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.295695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f49b-64ae-436e-b2b5-fed3e40b08ad admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.295695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f49b-64ae-436e-b2b5-fed3e40b08ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.295695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f49b-64ae-436e-b2b5-fed3e40b08ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.295695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056f49b-64ae-436e-b2b5-fed3e40b08ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.295695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056f49b-64ae-436e-b2b5-fed3e40b08ad admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.321708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.321944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1174/2340] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:19.356075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea1f77-710a-4346-acca-7cf9138ba36d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.369150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.370310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.371500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.373232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] PATH_INFO: `/v3/projects/6bae85ff2f97408eb7f162001b44a5a8/users/7c5f46201fa14176ba942f182245be9b/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.378004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bae85ff2f97408eb7f162001b44a5a8, user_id=7c5f46201fa14176ba942f182245be9b, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.387076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.433181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1167/2341] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:19 2022] PUT /identity/v3/projects/6bae85ff2f97408eb7f162001b44a5a8/users/7c5f46201fa14176ba942f182245be9b/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:19.435861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe095b-7e31-489e-8498-16bb4fc66c03 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.436267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe095b-7e31-489e-8498-16bb4fc66c03 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.436667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe095b-7e31-489e-8498-16bb4fc66c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.497641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7cfe095b-7e31-489e-8498-16bb4fc66c03 None None] MFA Rules not processed for user `7c5f46201fa14176ba942f182245be9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:19.499286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7cfe095b-7e31-489e-8498-16bb4fc66c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:19.636285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1175/2342] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:19.700057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:19.703202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:19.760680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:19.856651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbba99-c47c-409d-9cf7-955efbe13d7e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:19.864082 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:19.876548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:19.876548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:19.876548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:19.951051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:19.952619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:19.963997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1168/2343] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:20.487454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:21.244540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:21.719359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:21.720090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:21.720595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:21.744971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] MFA Rules not processed for user `4ba52b5b8b6f405396182116a4703a58`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:21.747105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:21.835482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1176/2344] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:21.921159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:21.922829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:21.987793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:21.992349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e2ab4-289d-4fb6-8a80-1be171ef4197 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:21.996282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b18f309b5cb4641997b637f8f17ac87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:21.997019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:21.997477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:21.997587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:22.000464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:22.155434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:22.158143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:22.179559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1169/2345] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:22.871268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:22.872761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:22.887948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d91633-5f3a-4a7a-b1f1-374b6e7f05a5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:22.893230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:22.896627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:22.896627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:22.896627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:22.897754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:22.908842 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:22.910568 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:22.932604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1177/2346] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:23.281082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:23.372518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:24.524018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:24.527151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:24.577307 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:24.592074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=100 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:24.592944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e802b9-968c-4cf7-9251-50f2ace3eb23 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:24.606463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:24.607112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:24.607388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:24.607659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:24.614182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:24.647252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d6023-8cb1-46ba-982e-3b32216657f0 service cinder] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:24.654998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:24.657056 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:24.657572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:24.659223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:24.663376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:24.668316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:24.669856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:24.682363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:24.684601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:24.709316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1170/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:24.714602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1178/2348] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:25.198690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:25.713120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:25.727216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c42d-e5b8-45aa-97ac-6e38378b0ae8 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:25.737078 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:25.737996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:25.738824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:25.739323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:25.751030 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:25.753971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:25.766767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1171/2349] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:26.834140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:33.535457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:33.672802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cde32f-4ec7-4991-85d2-4741fd9cd7a5 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:33.696385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:33.697465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:33.698853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:33.699298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:33.711938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:33.872097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:33.873822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:33.902986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1179/2350] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:01:35.763276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=24 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:36.881240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:36.883573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:37.004106 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc03d9a-1103-44b4-a88d-ff1546c2b8a6 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:37.016292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24f2ba-46e1-4788-b65e-bf4f8e513b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:37.016926 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f2ba-46e1-4788-b65e-bf4f8e513b35 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:37.017312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f2ba-46e1-4788-b65e-bf4f8e513b35 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:37.017686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f2ba-46e1-4788-b65e-bf4f8e513b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:37.019660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2d24f2ba-46e1-4788-b65e-bf4f8e513b35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:37.045008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24f2ba-46e1-4788-b65e-bf4f8e513b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:37.046801 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24f2ba-46e1-4788-b65e-bf4f8e513b35 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:37.086594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1172/2351] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:39.606699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:39.609131 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:39.763823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:39.831326 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2e9e9-eb52-4429-951f-9ed206e3f670 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:39.845383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:39.846208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:39.846481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:39.846772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] PATH_INFO: `/v3/users/9fe18de25036443d9161292e4df86775` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:39.851784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe18de25036443d9161292e4df86775)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:39.855111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:40.145835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe18de25036443d9161292e4df86775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:40.234179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe18de25036443d9161292e4df86775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:40.234517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe18de25036443d9161292e4df86775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:40.254541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe18de25036443d9161292e4df86775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:40.297754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe18de25036443d9161292e4df86775'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:40.312743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1180/2352] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:39 2022] DELETE /identity/v3/users/9fe18de25036443d9161292e4df86775 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:40.321713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:40.321713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:40.321713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:40.369449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:40.370893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:40.556889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1173/2353] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:40.658526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:40.661541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:40.789572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91837f52-8786-4ef4-a13c-d7a4f84c8ba3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:40.796356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38822a1a-bf08-40dc-b6e1-7ac6a358ba09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:40.797218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38822a1a-bf08-40dc-b6e1-7ac6a358ba09 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:40.797550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38822a1a-bf08-40dc-b6e1-7ac6a358ba09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:40.797833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38822a1a-bf08-40dc-b6e1-7ac6a358ba09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:40.811797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38822a1a-bf08-40dc-b6e1-7ac6a358ba09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:40.815000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38822a1a-bf08-40dc-b6e1-7ac6a358ba09 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:40.831218 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1181/2354] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:41.465485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:41.465485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:41.500282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386492-34cb-46c4-8a65-5fd2294abe71 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:41.506498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:41.507532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:41.508005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:41.508505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] PATH_INFO: `/v3/projects/2e2b0df30914433097c544ce0c429d35` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:41.510254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2b0df30914433097c544ce0c429d35)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:41.512516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:41.710648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2b0df30914433097c544ce0c429d35', 'request_id': 'req-7d5be084-11ac-4e81-b822-2afae59d1c91'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:41.791117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2b0df30914433097c544ce0c429d35', 'request_id': 'req-7d5be084-11ac-4e81-b822-2afae59d1c91'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:41.806505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2b0df30914433097c544ce0c429d35', 'request_id': 'req-7d5be084-11ac-4e81-b822-2afae59d1c91'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:41.826762 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] The token cache is being invalidate because project 2e2b0df30914433097c544ce0c429d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:41.827737 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:41.829260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-7d5be084-11ac-4e81-b822-2afae59d1c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:41.838223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1174/2355] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:41 2022] DELETE /identity/v3/projects/2e2b0df30914433097c544ce0c429d35 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:41.840276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573dbb-8fff-49d7-963f-005ebd65005b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:41.840781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573dbb-8fff-49d7-963f-005ebd65005b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:41.840893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c573dbb-8fff-49d7-963f-005ebd65005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:41.909321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9c573dbb-8fff-49d7-963f-005ebd65005b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:41.910537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9c573dbb-8fff-49d7-963f-005ebd65005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:41.983664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:42.068717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1182/2356] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:42.073697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aac4d-61a7-43ea-b826-87d13a1246b8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:42.074113 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aac4d-61a7-43ea-b826-87d13a1246b8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:42.074456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aac4d-61a7-43ea-b826-87d13a1246b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:42.139862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-364aac4d-61a7-43ea-b826-87d13a1246b8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:42.145575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-364aac4d-61a7-43ea-b826-87d13a1246b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:42.179850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1175/2357] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:42.180304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573dbb-8fff-49d7-963f-005ebd65005b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:42.194346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c573dbb-8fff-49d7-963f-005ebd65005b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:42.210610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:42.210610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:42.210610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:42.210610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:42.211103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:42.211103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:42.212211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:42.234727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1183/2358] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:42.240176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aac4d-61a7-43ea-b826-87d13a1246b8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:42.253562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364aac4d-61a7-43ea-b826-87d13a1246b8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:42.267566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:42.268607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:42.268881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:42.269146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:42.270214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:42.286566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:42.711583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:42.856992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1176/2359] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:42 2022] POST /identity/v3/projects => generated 367 bytes in 618 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:42.862453 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:42.892663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a541e4-8e72-43f4-8b12-b15585e17a71 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:43.093309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:43.093933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:43.094231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:43.094476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:43.095138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:43.099341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:43.247994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:43.248252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1184/2360] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:42 2022] POST /identity/v3/users => generated 284 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:43.272679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5340e28-d74a-4a1d-8446-409552ffa92e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:43.286740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:43.287988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:43.288282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:43.288741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:43.292098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:43.299403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:43.342549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1177/2361] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:43.347743 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:43.386130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073d677-0579-45d0-aad3-189364ec4be7 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:43.415478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c19daf-9e07-4d68-a88d-bfe86d2d1534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:43.415478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c19daf-9e07-4d68-a88d-bfe86d2d1534 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:43.415478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c19daf-9e07-4d68-a88d-bfe86d2d1534 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:43.415478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c19daf-9e07-4d68-a88d-bfe86d2d1534 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:43.417336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c19daf-9e07-4d68-a88d-bfe86d2d1534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:43.422479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c19daf-9e07-4d68-a88d-bfe86d2d1534 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:43.461461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1185/2362] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:43.472537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:43.505889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6490e2-bba0-40dc-a0f4-a6011c386e34 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:43.525072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:43.536376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:43.537537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:43.540778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] PATH_INFO: `/v3/projects/a730d7e2eff9468bb4f0a78055043615/users/352ee673f4914429a5c184c0648773d4/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:43.585696 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a730d7e2eff9468bb4f0a78055043615, user_id=352ee673f4914429a5c184c0648773d4, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:43.597702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:43.699526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1178/2363] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:43 2022] PUT /identity/v3/projects/a730d7e2eff9468bb4f0a78055043615/users/352ee673f4914429a5c184c0648773d4/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:43.719524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d009d5-19e9-4018-8a81-81e27355c721 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:43.719942 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d009d5-19e9-4018-8a81-81e27355c721 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:43.720173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d009d5-19e9-4018-8a81-81e27355c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:43.769222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c5d009d5-19e9-4018-8a81-81e27355c721 None None] MFA Rules not processed for user `352ee673f4914429a5c184c0648773d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:43.770603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c5d009d5-19e9-4018-8a81-81e27355c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:43.882009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1186/2364] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:43.931451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:43.933764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:44.090430 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ac747-8450-4654-92f8-4bce921f3a95 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:44.098128 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:44.098859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:44.099189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:44.099630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:44.116164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:44.118448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:44.146890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1179/2365] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:45.997073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:45.997543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:45.997644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:46.026779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:46.028489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:46.063077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:46.155717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1187/2366] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:46.941536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:46.971414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c00f-5f3b-4c59-b549-becf2ffc0799 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:46.981172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30689225-8acf-422b-8e6d-8af679ff3f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:46.982047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689225-8acf-422b-8e6d-8af679ff3f29 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:46.982521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689225-8acf-422b-8e6d-8af679ff3f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:46.982996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30689225-8acf-422b-8e6d-8af679ff3f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:46.985656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-30689225-8acf-422b-8e6d-8af679ff3f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:46.996616 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30689225-8acf-422b-8e6d-8af679ff3f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:46.998315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30689225-8acf-422b-8e6d-8af679ff3f29 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:47.010352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1180/2367] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:49.870616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:49.871608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:49.972494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6926325-33a8-4dd0-b1d4-dd9b7d68a6f5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:49.979322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:49.980549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:49.980864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:49.981217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] PATH_INFO: `/v3/users/6786216b35fd420fb608b783efcc0c79` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:49.982514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6786216b35fd420fb608b783efcc0c79)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:49.984616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:50.211325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6786216b35fd420fb608b783efcc0c79'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.299127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6786216b35fd420fb608b783efcc0c79'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.299897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6786216b35fd420fb608b783efcc0c79'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.312127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6786216b35fd420fb608b783efcc0c79'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.339588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6786216b35fd420fb608b783efcc0c79'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.353219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1188/2368] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:49 2022] DELETE /identity/v3/users/6786216b35fd420fb608b783efcc0c79 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:50.358495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:50.358997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:50.359709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:50.387775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:50.389217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:50.465041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:50.466492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:50.508060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1181/2369] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:50.518485 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:50.525095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:50.536236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:50.552780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07321a-2c5a-4d9f-ad69-d342fc530808 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:50.559113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:50.559749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:50.560029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:50.560296 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] PATH_INFO: `/v3/users/d82135271d994cc5b3930fd6d97a6657` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:50.561449 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82135271d994cc5b3930fd6d97a6657)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:50.563450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:50.622829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a794ec-6e85-4856-842e-f993d1fc86ff None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:50.629426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd7534-36dc-4ce4-93cd-519172935dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:50.630207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd7534-36dc-4ce4-93cd-519172935dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:50.630481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd7534-36dc-4ce4-93cd-519172935dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:50.631542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd7534-36dc-4ce4-93cd-519172935dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:50.639592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:50.643904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd7534-36dc-4ce4-93cd-519172935dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:50.645488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd7534-36dc-4ce4-93cd-519172935dd8 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:50.656636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1182/2370] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:50.786076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82135271d994cc5b3930fd6d97a6657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.899122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82135271d994cc5b3930fd6d97a6657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.900695 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82135271d994cc5b3930fd6d97a6657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.928223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82135271d994cc5b3930fd6d97a6657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.945383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82135271d994cc5b3930fd6d97a6657'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:50.955880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1189/2371] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:01:50 2022] DELETE /identity/v3/users/d82135271d994cc5b3930fd6d97a6657 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:50.967077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:50.967713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:50.968053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:51.000557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:51.001747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:51.072775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1183/2372] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:51.078399 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:51.079913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:51.083367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:51.085110 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:51.118465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4593c2-5acc-4c58-8fe8-977dcf6f6dc9 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:51.134915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:51.136382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:51.143928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:51.144611 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] PATH_INFO: `/v3/projects/c062133972ff4ef587a62c49af30ec1c` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:51.147572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c062133972ff4ef587a62c49af30ec1c)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:51.152079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:51.180353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec074d6-8ada-4c5a-b577-07896b35a80d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:51.188574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:51.189245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:51.190035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:51.190298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:51.206560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:51.208042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:51.217959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1184/2373] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:51.350259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c062133972ff4ef587a62c49af30ec1c', 'request_id': 'req-79dfc885-2ab4-4622-8e78-c4334e313764'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:51.432066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c062133972ff4ef587a62c49af30ec1c', 'request_id': 'req-79dfc885-2ab4-4622-8e78-c4334e313764'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:51.451371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c062133972ff4ef587a62c49af30ec1c', 'request_id': 'req-79dfc885-2ab4-4622-8e78-c4334e313764'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:51.475064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] The token cache is being invalidate because project c062133972ff4ef587a62c49af30ec1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:51.476319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:51.477244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:51.480097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1190/2374] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:51 2022] DELETE /identity/v3/projects/c062133972ff4ef587a62c49af30ec1c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:01:51.607640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:51.609331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:51.634864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51d28f-3b2b-48c6-bda5-4ad92511745e service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:51.755886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:51.756700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:51.757021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:51.757507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] PATH_INFO: `/v3/projects/fddfa3106a1c43cb8e4691153b6cbfc9` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:51.758886 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddfa3106a1c43cb8e4691153b6cbfc9)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:51.760976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:51.870459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:51.873682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:51.945223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddfa3106a1c43cb8e4691153b6cbfc9', 'request_id': 'req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:51.974808 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfc885-2ab4-4622-8e78-c4334e313764 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:52.060784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddfa3106a1c43cb8e4691153b6cbfc9', 'request_id': 'req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:52.070493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddfa3106a1c43cb8e4691153b6cbfc9', 'request_id': 'req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:52.087285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] The token cache is being invalidate because project fddfa3106a1c43cb8e4691153b6cbfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:01:52.087581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:52.088393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5721290d-2cd2-4cbb-8670-a06d6b29c4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:01:52.090257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1185/2375] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:51 2022] DELETE /identity/v3/projects/fddfa3106a1c43cb8e4691153b6cbfc9 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:01:52.094474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0f301-3c9f-49ea-a643-8107f6f66f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:52.094474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f301-3c9f-49ea-a643-8107f6f66f16 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.094474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f301-3c9f-49ea-a643-8107f6f66f16 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.094474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f301-3c9f-49ea-a643-8107f6f66f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.096327 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-faf0f301-3c9f-49ea-a643-8107f6f66f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:52.096944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34411dca-0e38-4b3a-b1dc-a94d27320a3a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.097405 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34411dca-0e38-4b3a-b1dc-a94d27320a3a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.098958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34411dca-0e38-4b3a-b1dc-a94d27320a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.111164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0f301-3c9f-49ea-a643-8107f6f66f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:52.113955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0f301-3c9f-49ea-a643-8107f6f66f16 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:52.148473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-34411dca-0e38-4b3a-b1dc-a94d27320a3a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:52.149804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-34411dca-0e38-4b3a-b1dc-a94d27320a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:52.151011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1191/2376] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:52.287541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e732-2a2d-4d56-b598-5a22b8a1d959 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.287891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e732-2a2d-4d56-b598-5a22b8a1d959 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.288095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e732-2a2d-4d56-b598-5a22b8a1d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.289187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1186/2377] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:52.310876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fa07e732-2a2d-4d56-b598-5a22b8a1d959 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:52.312303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fa07e732-2a2d-4d56-b598-5a22b8a1d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:52.331999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1192/2378] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:52.336620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34411dca-0e38-4b3a-b1dc-a94d27320a3a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:52.350874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34411dca-0e38-4b3a-b1dc-a94d27320a3a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:52.367014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:52.367014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.367014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.367014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.368175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:01:52.368175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:52.368175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:52.382185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1187/2379] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:01:52.387304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e732-2a2d-4d56-b598-5a22b8a1d959 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:52.397907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e732-2a2d-4d56-b598-5a22b8a1d959 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:52.403374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:52.404077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.404427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.404696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.405332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:52.407374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:52.421366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:52.530603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1193/2380] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:01:52 2022] POST /identity/v3/projects => generated 359 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:52.531906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:52.548474 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196a162-4151-4dd2-9d7f-0e28874dee22 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:52.599187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:52.670497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:52.671857 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.672157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.672703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.673884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:52.680644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:52.839488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1188/2381] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:01:52 2022] POST /identity/v3/users => generated 280 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:01:52.844862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:52.855938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91d41f-a7f5-4090-abb6-9242aa389ff4 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:52.864088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:52.865071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.865531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.871197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.871197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:52.871197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:52.884834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1194/2382] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:52.889961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:52.903591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a98e-e5d4-47d6-b817-41376ccd223e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:52.910806 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18c22d-f3f2-46b2-b567-726182549637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:52.911805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c22d-f3f2-46b2-b567-726182549637 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.912156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c22d-f3f2-46b2-b567-726182549637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.912493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c22d-f3f2-46b2-b567-726182549637 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.913284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18c22d-f3f2-46b2-b567-726182549637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:52.914941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18c22d-f3f2-46b2-b567-726182549637 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:52.934347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1189/2383] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:01:52.934459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:52.942936 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65f991-913d-40a6-90ad-eb9bac5b5367 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:52.947749 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:52.948413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:52.948689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:52.948959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] PATH_INFO: `/v3/projects/42c5c6205dc84338bf6f64b2043189ca/users/288bf49fe4644dc2bdc66236eb4f1836/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:52.967098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c5c6205dc84338bf6f64b2043189ca, user_id=288bf49fe4644dc2bdc66236eb4f1836, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:52.970069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:53.105470 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1195/2384] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:01:52 2022] PUT /identity/v3/projects/42c5c6205dc84338bf6f64b2043189ca/users/288bf49fe4644dc2bdc66236eb4f1836/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:01:53.115931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:53.116268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:53.116472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:53.147291 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] MFA Rules not processed for user `288bf49fe4644dc2bdc66236eb4f1836`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:01:53.149190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:53.271784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1190/2385] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:01:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:01:53.296049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:53.298388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:53.446803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859040a-ccc9-407d-b251-a9c7f13b5e85 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:53.450838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:53.451534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:53.451818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:53.452414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:53.464116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:53.465604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:53.482379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1196/2386] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:01:53.874046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:57.010426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:01:57.011889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:57.035779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d80bc9-773c-461a-bbd4-6ed354aeb949 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:01:57.047622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:01:57.048582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:01:57.049189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:01:57.049691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:01:57.052664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:01:57.159326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:01:57.160946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:01:57.178527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1191/2387] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:01:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:02.275141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:02.275141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:02.318048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:02.393996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d05591-bca2-4457-b8ed-a0f17becf69f service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:02.403101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096959-6b5f-40e8-9e05-a5fb2b7b9b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:02.404167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096959-6b5f-40e8-9e05-a5fb2b7b9b88 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:02.404632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096959-6b5f-40e8-9e05-a5fb2b7b9b88 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:02.405062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096959-6b5f-40e8-9e05-a5fb2b7b9b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:02.408067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1c096959-6b5f-40e8-9e05-a5fb2b7b9b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:02.425569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096959-6b5f-40e8-9e05-a5fb2b7b9b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:02.428030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096959-6b5f-40e8-9e05-a5fb2b7b9b88 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:02.445197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1197/2388] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:07.173046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=47 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:08.771206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:08.773338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:08.864663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22ec94-b77f-4676-99e6-92ad6091ca5e service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:08.869419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:08.870085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:08.870355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:08.870621 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] PATH_INFO: `/v3/users/352ee673f4914429a5c184c0648773d4` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:08.871841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] RBAC: Authorizing `identity:delete_user(user_id=352ee673f4914429a5c184c0648773d4)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:08.873761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:09.180207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352ee673f4914429a5c184c0648773d4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:09.268223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352ee673f4914429a5c184c0648773d4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:09.286153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352ee673f4914429a5c184c0648773d4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:09.287232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352ee673f4914429a5c184c0648773d4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:09.296722 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352ee673f4914429a5c184c0648773d4'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:09.304755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1192/2389] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:08 2022] DELETE /identity/v3/users/352ee673f4914429a5c184c0648773d4 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:09.309525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:09.310087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:09.310396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:09.336345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:09.337836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:09.434149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1198/2390] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:09.445443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:09.447905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:09.525349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ea3e1-094d-41ee-8df5-702bfe4fceca admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:09.530089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:09.530825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:09.531330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:09.531678 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:09.548712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:09.550655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:09.576891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1193/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:09.984959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:09.991909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:10.008630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5a197-7772-49a6-8f8b-873024d87e3c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:10.016736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:10.030128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:10.030768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:10.031279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] PATH_INFO: `/v3/projects/a730d7e2eff9468bb4f0a78055043615` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:10.033563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a730d7e2eff9468bb4f0a78055043615)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:10.036368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:10.239700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a730d7e2eff9468bb4f0a78055043615', 'request_id': 'req-822077cc-4719-43f3-b4fa-dd103ab7c00c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:10.330502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a730d7e2eff9468bb4f0a78055043615', 'request_id': 'req-822077cc-4719-43f3-b4fa-dd103ab7c00c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:10.338519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a730d7e2eff9468bb4f0a78055043615', 'request_id': 'req-822077cc-4719-43f3-b4fa-dd103ab7c00c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:10.357202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] The token cache is being invalidate because project a730d7e2eff9468bb4f0a78055043615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:10.357727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:10.359318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-822077cc-4719-43f3-b4fa-dd103ab7c00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:10.376628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1199/2392] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:09 2022] DELETE /identity/v3/projects/a730d7e2eff9468bb4f0a78055043615 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:11.040192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:11.041983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:11.062640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24c20d-2170-415e-bb66-ee7c2242252d service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:11.083264 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:11.137009 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:11.137759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:11.138384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:11.138865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] PATH_INFO: `/v3/users/288bf49fe4644dc2bdc66236eb4f1836` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:11.140203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288bf49fe4644dc2bdc66236eb4f1836)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:11.142213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:11.348438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288bf49fe4644dc2bdc66236eb4f1836'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:11.484837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288bf49fe4644dc2bdc66236eb4f1836'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:11.502862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288bf49fe4644dc2bdc66236eb4f1836'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:11.503623 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288bf49fe4644dc2bdc66236eb4f1836'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:11.513653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288bf49fe4644dc2bdc66236eb4f1836'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:11.522453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1194/2393] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:11 2022] DELETE /identity/v3/users/288bf49fe4644dc2bdc66236eb4f1836 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:11.526907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:11.527789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:11.528106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:11.550033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:11.551263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:11.583366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:11.632925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1200/2394] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:11.643062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:11.644522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:11.716840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dbad4-e595-48be-aade-8828bd72b085 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:11.720765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a00d2d-dffa-46e0-bc0c-bce228460c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:11.721447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a00d2d-dffa-46e0-bc0c-bce228460c85 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:11.722627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a00d2d-dffa-46e0-bc0c-bce228460c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:11.722627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a00d2d-dffa-46e0-bc0c-bce228460c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:11.733808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a00d2d-dffa-46e0-bc0c-bce228460c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:11.734898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a00d2d-dffa-46e0-bc0c-bce228460c85 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:11.751047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1195/2395] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:12.026322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:12.026322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:12.041926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a067ba2-0fcc-4f91-9018-89c78f9422b9 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:12.047034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:12.048119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:12.048119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:12.050427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] PATH_INFO: `/v3/projects/42c5c6205dc84338bf6f64b2043189ca` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:12.050427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c5c6205dc84338bf6f64b2043189ca)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:12.052505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:12.221566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c5c6205dc84338bf6f64b2043189ca', 'request_id': 'req-07977abf-ee9d-4b20-9854-5e6314ec546a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:12.318567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c5c6205dc84338bf6f64b2043189ca', 'request_id': 'req-07977abf-ee9d-4b20-9854-5e6314ec546a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:12.324518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c5c6205dc84338bf6f64b2043189ca', 'request_id': 'req-07977abf-ee9d-4b20-9854-5e6314ec546a'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:12.336845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] The token cache is being invalidate because project 42c5c6205dc84338bf6f64b2043189ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:12.337225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:12.338026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-07977abf-ee9d-4b20-9854-5e6314ec546a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:12.339659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1201/2396] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:12 2022] DELETE /identity/v3/projects/42c5c6205dc84338bf6f64b2043189ca => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:12.345677 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1b05-42dd-4403-aca7-891582f43a9e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:12.346276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1b05-42dd-4403-aca7-891582f43a9e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:12.346529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1b05-42dd-4403-aca7-891582f43a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:12.369316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4afa1b05-42dd-4403-aca7-891582f43a9e None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:12.370619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4afa1b05-42dd-4403-aca7-891582f43a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:12.448771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:12.472139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1196/2397] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:12.480709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c55cd-436f-4720-aa46-145ef26a33f7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:12.481093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c55cd-436f-4720-aa46-145ef26a33f7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:12.482049 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c55cd-436f-4720-aa46-145ef26a33f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:12.509770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-2b6c55cd-436f-4720-aa46-145ef26a33f7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:12.511083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2b6c55cd-436f-4720-aa46-145ef26a33f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:12.527681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1202/2398] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:12.532404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa1b05-42dd-4403-aca7-891582f43a9e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:12.549798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa1b05-42dd-4403-aca7-891582f43a9e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:12.553371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:12.554199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:12.554632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:12.555071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:12.555733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:12.559245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:12.561111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:12.576160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1197/2399] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:12.580320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c55cd-436f-4720-aa46-145ef26a33f7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:12.592576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c55cd-436f-4720-aa46-145ef26a33f7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:12.598976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:12.599631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:12.599910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:12.600283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:12.601095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:12.603440 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:12.772458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1203/2400] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:12 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:12.776705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:12.788856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d2baa-65df-482c-ae6e-751376ad75c3 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:12.857422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:12.858042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:12.858321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:12.858613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:12.859453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:12.861995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:12.947893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1198/2401] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:12 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:12.953960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:12.968799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44489052-96c6-49a7-a640-e26bf611fc63 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:12.975711 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:12.976348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:12.976630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:12.977033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:12.977872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:12.979617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:12.995929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1204/2402] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:12.996667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.009486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae04cd-1032-4f7b-b405-3d3169da1a1a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:13.015269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ef4e1-994c-4fc5-857d-88b55dce4b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:13.019543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef4e1-994c-4fc5-857d-88b55dce4b10 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.019543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef4e1-994c-4fc5-857d-88b55dce4b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.019543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ef4e1-994c-4fc5-857d-88b55dce4b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.019543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ef4e1-994c-4fc5-857d-88b55dce4b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:13.019543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ef4e1-994c-4fc5-857d-88b55dce4b10 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:13.031385 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1199/2403] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:13.035443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.046694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a508c-3c29-40ea-a51b-b2ad7a4d0c97 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:13.054821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:13.056246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.056685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.057125 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] PATH_INFO: `/v3/projects/fea74ec1cef84d5d8533684dc2ea706f/users/27e89f049fa2413c88188fa13c9f4d57/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.075881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea74ec1cef84d5d8533684dc2ea706f, user_id=27e89f049fa2413c88188fa13c9f4d57, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:13.078900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:13.185128 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1205/2404] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:13 2022] PUT /identity/v3/projects/fea74ec1cef84d5d8533684dc2ea706f/users/27e89f049fa2413c88188fa13c9f4d57/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:02:13.197216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bd3c0-bd0e-4e6d-9459-1bf8b49788f3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.197536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bd3c0-bd0e-4e6d-9459-1bf8b49788f3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.197747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bd3c0-bd0e-4e6d-9459-1bf8b49788f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.235605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-082bd3c0-bd0e-4e6d-9459-1bf8b49788f3 None None] MFA Rules not processed for user `27e89f049fa2413c88188fa13c9f4d57`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:13.237785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-082bd3c0-bd0e-4e6d-9459-1bf8b49788f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:13.321362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1200/2405] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:13.325920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.385377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:13.400123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49540cd-3f7c-4ae9-9d8d-43b8d8db237d admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:13.405169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:13.405781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.406111 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.406379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.407044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:13.409780 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:13.509018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1206/2406] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:13 2022] POST /identity/v3/projects => generated 393 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:13.514245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bd3c0-bd0e-4e6d-9459-1bf8b49788f3 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.526189 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bd3c0-bd0e-4e6d-9459-1bf8b49788f3 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:13.600399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:13.601266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.601536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.601824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.602470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:13.604491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:13.683123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1201/2407] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:13 2022] POST /identity/v3/users => generated 303 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:13.687627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.700909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308e734-65af-4079-806c-536e1dd4601a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:13.706754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:13.707377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.707746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.708017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.708767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:13.710581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:13.725393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1207/2408] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:02:13.730246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.740967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea66c8e-e0cd-4917-a450-b1f2f46c8591 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:13.745901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:13.746577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.747036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.747312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] PATH_INFO: `/v3/projects/bc1ca83a85b44586b26265c0bca3a9ce/users/42d3d40e29394f5896421858b023c5d9/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.764267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1ca83a85b44586b26265c0bca3a9ce, user_id=42d3d40e29394f5896421858b023c5d9, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:13.766745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:13.872497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1202/2409] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:13 2022] PUT /identity/v3/projects/bc1ca83a85b44586b26265c0bca3a9ce/users/42d3d40e29394f5896421858b023c5d9/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:13.876476 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.887505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eef04-7fea-4468-8bc4-cfb35c19d7eb admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:13.955841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83379b-409a-4695-82cc-d58fad53ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:13.956436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83379b-409a-4695-82cc-d58fad53ae6c admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:13.956706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83379b-409a-4695-82cc-d58fad53ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:13.957013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83379b-409a-4695-82cc-d58fad53ae6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:13.957608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83379b-409a-4695-82cc-d58fad53ae6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:13.959319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83379b-409a-4695-82cc-d58fad53ae6c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:13.980473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:13.981347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1208/2410] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:02:13.995363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a601d-6e68-4cc1-a892-4f055b3341f2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:14.001370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:14.002293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:14.002586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:14.002889 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] PATH_INFO: `/v3/projects/bc1ca83a85b44586b26265c0bca3a9ce/users/42d3d40e29394f5896421858b023c5d9/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:14.009155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1ca83a85b44586b26265c0bca3a9ce, user_id=42d3d40e29394f5896421858b023c5d9, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:14.012345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:14.025811 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1203/2411] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:13 2022] PUT /identity/v3/projects/bc1ca83a85b44586b26265c0bca3a9ce/users/42d3d40e29394f5896421858b023c5d9/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:14.037584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:14.038698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:14.039313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:14.106502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] MFA Rules not processed for user `42d3d40e29394f5896421858b023c5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:14.108004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:14.181671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:14.267045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1209/2412] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:14.268500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:14.270294 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:14.375241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029d54a-89ce-4226-baeb-5f203e6e5a29 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:14.384279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:14.385222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:14.385731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:14.385906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:14.474809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:14.476476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:14.487602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1204/2413] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:02:21.617348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:21.620357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:21.696594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:21.709221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a9f68-32ca-4d59-b99b-1cce7c43177a None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:21.715322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbad1f-f8a9-4019-9fad-cd54b7f544a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:21.716273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbad1f-f8a9-4019-9fad-cd54b7f544a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:21.716557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbad1f-f8a9-4019-9fad-cd54b7f544a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:21.716824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbad1f-f8a9-4019-9fad-cd54b7f544a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:21.740519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbad1f-f8a9-4019-9fad-cd54b7f544a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:21.748872 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbad1f-f8a9-4019-9fad-cd54b7f544a4 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:21.767067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1210/2414] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:22.343903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:22.347112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:22.397822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:22.448040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef2138-ee7f-45e7-8100-d72aacd5328d service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:22.453785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:22.455482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:22.456191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:22.456191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] PATH_INFO: `/v3/users/c2b2a5f359384a179f8cfa23692f3bee` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:22.457442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b2a5f359384a179f8cfa23692f3bee)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:22.459455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:22.826901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b2a5f359384a179f8cfa23692f3bee'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.930495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b2a5f359384a179f8cfa23692f3bee'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.945808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b2a5f359384a179f8cfa23692f3bee'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.946542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b2a5f359384a179f8cfa23692f3bee'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.954210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b2a5f359384a179f8cfa23692f3bee'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:22.960534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1205/2415] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:22 2022] DELETE /identity/v3/users/c2b2a5f359384a179f8cfa23692f3bee => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:02:22.965156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:22.965678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:22.965678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:22.988273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:22.989230 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:23.069822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1211/2416] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:23.080991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:23.083292 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:23.178712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da2fb9-9eec-4cab-9847-5473a6967337 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:23.181138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fc998-30ea-4350-a07a-99293ec96e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:23.181792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fc998-30ea-4350-a07a-99293ec96e5b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:23.182088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fc998-30ea-4350-a07a-99293ec96e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:23.182492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fc998-30ea-4350-a07a-99293ec96e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:23.197376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fc998-30ea-4350-a07a-99293ec96e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:23.199864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fc998-30ea-4350-a07a-99293ec96e5b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:23.212146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1206/2417] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:23.540968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:23.540968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:23.557538 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78793254-44ea-4eeb-a333-4a84dc29c323 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:23.563246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:23.564401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:23.564905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:23.565410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] PATH_INFO: `/v3/projects/ca63ccf8f825493e97e93fc2a91c67ac` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:23.567722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca63ccf8f825493e97e93fc2a91c67ac)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:23.574194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:23.747364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca63ccf8f825493e97e93fc2a91c67ac', 'request_id': 'req-a0c473c3-00eb-4e36-8d43-66c665e8ff66'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:23.871402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca63ccf8f825493e97e93fc2a91c67ac', 'request_id': 'req-a0c473c3-00eb-4e36-8d43-66c665e8ff66'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:23.879607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca63ccf8f825493e97e93fc2a91c67ac', 'request_id': 'req-a0c473c3-00eb-4e36-8d43-66c665e8ff66'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:23.898350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] The token cache is being invalidate because project ca63ccf8f825493e97e93fc2a91c67ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:23.898831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:23.900058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a0c473c3-00eb-4e36-8d43-66c665e8ff66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:23.910053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1212/2418] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:23 2022] DELETE /identity/v3/projects/ca63ccf8f825493e97e93fc2a91c67ac => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:23.910275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d252-37ab-40bb-9537-b61fa279b0db None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:23.910275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d252-37ab-40bb-9537-b61fa279b0db None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:23.910275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190d252-37ab-40bb-9537-b61fa279b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:23.936203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7190d252-37ab-40bb-9537-b61fa279b0db None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:23.937446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7190d252-37ab-40bb-9537-b61fa279b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:24.010825 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:24.030521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1207/2419] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:24.039355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079b0f7-5b0a-48eb-9551-7dfa5178957c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.040232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079b0f7-5b0a-48eb-9551-7dfa5178957c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.040501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079b0f7-5b0a-48eb-9551-7dfa5178957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.067123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d079b0f7-5b0a-48eb-9551-7dfa5178957c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:24.069169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d079b0f7-5b0a-48eb-9551-7dfa5178957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:24.084770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d252-37ab-40bb-9537-b61fa279b0db None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.085407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1213/2420] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:02:24.095033 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190d252-37ab-40bb-9537-b61fa279b0db None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.100679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.101389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.101732 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.102068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.102830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:24.103199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.104866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.120035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1208/2421] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:24.123605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079b0f7-5b0a-48eb-9551-7dfa5178957c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.153116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079b0f7-5b0a-48eb-9551-7dfa5178957c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.161163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.164272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.164554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.165006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.165674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.167862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.367672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1214/2422] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:24.372504 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.406138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a92ab-0ca2-4002-9be4-aa978c7f926c admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.505592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.507380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.507853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.508347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.509580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.512131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.603135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1209/2423] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:24.609021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.639116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fac3c-41f1-4641-92ea-4c0f27727da4 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.653031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594805-2266-435d-aa18-8733744af738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.653031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594805-2266-435d-aa18-8733744af738 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.653031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594805-2266-435d-aa18-8733744af738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.653031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20594805-2266-435d-aa18-8733744af738 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.654518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20594805-2266-435d-aa18-8733744af738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.656663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20594805-2266-435d-aa18-8733744af738 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.672077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1215/2424] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:02:24.677001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.693800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5962-52ca-45c9-9409-7a636cd9131a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.699782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c1c7e-c5de-4cf7-9741-98bea5c61ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.700431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c1c7e-c5de-4cf7-9741-98bea5c61ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.700778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c1c7e-c5de-4cf7-9741-98bea5c61ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.701049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c1c7e-c5de-4cf7-9741-98bea5c61ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.701712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c1c7e-c5de-4cf7-9741-98bea5c61ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.703429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c1c7e-c5de-4cf7-9741-98bea5c61ac5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.720227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1210/2425] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:24.726345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594805-2266-435d-aa18-8733744af738 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:24.741806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20594805-2266-435d-aa18-8733744af738 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:24.752982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:24.753546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.753818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.754097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] PATH_INFO: `/v3/projects/7b88926599eb4e85b20333d2c4c7fa8a/users/fb3ca8d291624b08bfb0419229b8a6ac/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.771347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b88926599eb4e85b20333d2c4c7fa8a, user_id=fb3ca8d291624b08bfb0419229b8a6ac, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:24.774099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:24.873871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1216/2426] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:24 2022] PUT /identity/v3/projects/7b88926599eb4e85b20333d2c4c7fa8a/users/fb3ca8d291624b08bfb0419229b8a6ac/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:02:24.883831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd2a5-bd46-4e7a-ad94-2ebcb0b6d2a4 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:24.883831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd2a5-bd46-4e7a-ad94-2ebcb0b6d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:24.883831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd2a5-bd46-4e7a-ad94-2ebcb0b6d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:24.918638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-920bd2a5-bd46-4e7a-ad94-2ebcb0b6d2a4 None None] MFA Rules not processed for user `fb3ca8d291624b08bfb0419229b8a6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:24.919909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-920bd2a5-bd46-4e7a-ad94-2ebcb0b6d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:24.994704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1211/2427] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:25.008227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:25.010021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:25.017541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:25.088249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3dbf-a679-4480-bf6a-41530264c6e7 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:25.092713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:25.093344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.093623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.093893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.104317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:25.105708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:25.116529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1217/2428] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:25.781682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23608-c26d-4254-8503-3f3001df43cd None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:25.781991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23608-c26d-4254-8503-3f3001df43cd None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:25.782250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e23608-c26d-4254-8503-3f3001df43cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:25.806165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-94e23608-c26d-4254-8503-3f3001df43cd None None] MFA Rules not processed for user `27e89f049fa2413c88188fa13c9f4d57`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:25.807729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-94e23608-c26d-4254-8503-3f3001df43cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:25.866702 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:25.892568 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1212/2429] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:35.515507 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.586746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc526f-a2ce-41b2-b234-ac346cb47926 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:35.591433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:35.592098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.592373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.592640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] PATH_INFO: `/v3/users/fb3ca8d291624b08bfb0419229b8a6ac` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.593776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3ca8d291624b08bfb0419229b8a6ac)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:35.595744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:35.764006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3ca8d291624b08bfb0419229b8a6ac'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:35.814463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3ca8d291624b08bfb0419229b8a6ac'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:35.815043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3ca8d291624b08bfb0419229b8a6ac'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:35.828221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3ca8d291624b08bfb0419229b8a6ac'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:35.849909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3ca8d291624b08bfb0419229b8a6ac'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:35.861046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1218/2430] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:35 2022] DELETE /identity/v3/users/fb3ca8d291624b08bfb0419229b8a6ac => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:35.866537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:35.870210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:35.870210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:35.888233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:35.889441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:35.952064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1213/2431] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:35.962480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:35.963961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:35.996198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:36.027005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7aaf-1e6b-4142-97ec-4a1520206dac admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.030627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f3e7b-ac87-459c-88b6-752e605eb2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.031361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f3e7b-ac87-459c-88b6-752e605eb2ea service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.031634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f3e7b-ac87-459c-88b6-752e605eb2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.031899 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f3e7b-ac87-459c-88b6-752e605eb2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.041419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f3e7b-ac87-459c-88b6-752e605eb2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:36.042979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f3e7b-ac87-459c-88b6-752e605eb2ea service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:36.052513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1219/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:36.376322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:36.378786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:36.392218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a8fa-807c-4ef7-ab80-1bd913f15dc0 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.397359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.398066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.398275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.398540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] PATH_INFO: `/v3/projects/7b88926599eb4e85b20333d2c4c7fa8a` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.400173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b88926599eb4e85b20333d2c4c7fa8a)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:36.402428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:36.542290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b88926599eb4e85b20333d2c4c7fa8a', 'request_id': 'req-ffc4d04d-5437-4140-b32f-7612ead5aed9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:36.630413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b88926599eb4e85b20333d2c4c7fa8a', 'request_id': 'req-ffc4d04d-5437-4140-b32f-7612ead5aed9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:36.636680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b88926599eb4e85b20333d2c4c7fa8a', 'request_id': 'req-ffc4d04d-5437-4140-b32f-7612ead5aed9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:36.648166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] The token cache is being invalidate because project 7b88926599eb4e85b20333d2c4c7fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:36.648445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:36.649084 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ffc4d04d-5437-4140-b32f-7612ead5aed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:36.650611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1214/2433] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:36 2022] DELETE /identity/v3/projects/7b88926599eb4e85b20333d2c4c7fa8a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:36.655766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f68b2-3245-4368-80fa-a018805a8d0c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.656283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f68b2-3245-4368-80fa-a018805a8d0c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.656389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f68b2-3245-4368-80fa-a018805a8d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.678247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-5a5f68b2-3245-4368-80fa-a018805a8d0c None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:36.679570 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5a5f68b2-3245-4368-80fa-a018805a8d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:36.743818 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1220/2434] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:36.751781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa5081-b691-476c-ae9b-0e4411d04b34 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.752066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa5081-b691-476c-ae9b-0e4411d04b34 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.752351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa5081-b691-476c-ae9b-0e4411d04b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.772225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cdaa5081-b691-476c-ae9b-0e4411d04b34 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:36.773407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cdaa5081-b691-476c-ae9b-0e4411d04b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:36.781293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1215/2435] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:36.786034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f68b2-3245-4368-80fa-a018805a8d0c None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:36.795897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f68b2-3245-4368-80fa-a018805a8d0c None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.801081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.801668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.801939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.802204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.802873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:36.803171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:36.804810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:36.816753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1221/2436] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 10:02:36.821131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa5081-b691-476c-ae9b-0e4411d04b34 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:36.830605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa5081-b691-476c-ae9b-0e4411d04b34 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.835188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.838335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.838335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:36.838335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:36.838335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:36.838836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:36.926643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1216/2437] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:36 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:36.930914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:36.941393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a454f1-7d1d-4bfa-aa44-75726695a022 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:36.998875 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:36.999535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:36.999811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:37.000080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:37.000722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:37.002639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:37.121956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1222/2438] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:36 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:37.126092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:37.136369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decc0e8-e494-40bf-9012-b3a400c1ee3e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:37.141276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:37.142749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:37.142749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:37.142749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:37.143079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:37.145160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:37.154977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1217/2439] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:37.158921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:37.169415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7228c2e-5c4b-4c39-82fc-c48b3b078b6e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:37.174235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595c5e3-462e-4f13-a272-ce5e752a3f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:37.174908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595c5e3-462e-4f13-a272-ce5e752a3f97 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:37.175191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595c5e3-462e-4f13-a272-ce5e752a3f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:37.175464 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595c5e3-462e-4f13-a272-ce5e752a3f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:37.176102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595c5e3-462e-4f13-a272-ce5e752a3f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:37.177693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595c5e3-462e-4f13-a272-ce5e752a3f97 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:37.188623 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1223/2440] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:02:37.192887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:37.202922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b185f-008c-418b-a7c6-1ef3c851a248 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:37.207941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:37.208579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:37.208854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:37.209121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] PATH_INFO: `/v3/projects/4cc4fecab91b42d3bede018c959724c6/users/382f4ce4314140b18806305c07d42bad/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:37.224313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc4fecab91b42d3bede018c959724c6, user_id=382f4ce4314140b18806305c07d42bad, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:37.227000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:37.313162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1218/2441] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:37 2022] PUT /identity/v3/projects/4cc4fecab91b42d3bede018c959724c6/users/382f4ce4314140b18806305c07d42bad/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:37.323874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f0a0-e6bf-437f-988e-f7aa55820ee7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:37.324156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f0a0-e6bf-437f-988e-f7aa55820ee7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:37.324428 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6f0a0-e6bf-437f-988e-f7aa55820ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:37.353169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cfe6f0a0-e6bf-437f-988e-f7aa55820ee7 None None] MFA Rules not processed for user `382f4ce4314140b18806305c07d42bad`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:37.354368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cfe6f0a0-e6bf-437f-988e-f7aa55820ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:37.382580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:37.423067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1224/2442] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:37.434691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:37.436912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:37.452526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:37.501911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3aa2-559f-4f96-8a4f-57bbfc5b71e1 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:37.506577 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027efcba-a57b-4323-8fe9-729c8cb68a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:37.507217 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efcba-a57b-4323-8fe9-729c8cb68a14 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:37.507492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efcba-a57b-4323-8fe9-729c8cb68a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:37.508022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027efcba-a57b-4323-8fe9-729c8cb68a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:37.518438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027efcba-a57b-4323-8fe9-729c8cb68a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:37.520627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027efcba-a57b-4323-8fe9-729c8cb68a14 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:37.530412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1219/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:37.545879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6f0a0-e6bf-437f-988e-f7aa55820ee7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:37.616776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6f0a0-e6bf-437f-988e-f7aa55820ee7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:37.621961 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:37.622576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:37.622884 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:37.623149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] PATH_INFO: `/v3/users/382f4ce4314140b18806305c07d42bad` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:37.624257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=382f4ce4314140b18806305c07d42bad)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:37.626169 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:37.885979 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382f4ce4314140b18806305c07d42bad'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.013236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382f4ce4314140b18806305c07d42bad'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.013890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382f4ce4314140b18806305c07d42bad'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.022116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382f4ce4314140b18806305c07d42bad'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.036136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382f4ce4314140b18806305c07d42bad'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:38.042947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1225/2444] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:02:37 2022] DELETE /identity/v3/users/382f4ce4314140b18806305c07d42bad => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:38.047694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:38.048208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:38.048455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:38.069190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:38.070397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:38.130029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1220/2445] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:38.139714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:38.141114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:38.203677 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b57bc4-3dd6-4980-be0e-0e922d6e08e0 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:38.207383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170f4b1-c05c-40bb-aaf3-1b14b5953951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:38.207940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f4b1-c05c-40bb-aaf3-1b14b5953951 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:38.208214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f4b1-c05c-40bb-aaf3-1b14b5953951 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:38.208480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f4b1-c05c-40bb-aaf3-1b14b5953951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:38.218273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170f4b1-c05c-40bb-aaf3-1b14b5953951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:38.221251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170f4b1-c05c-40bb-aaf3-1b14b5953951 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:38.230740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1226/2446] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:38.244905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:38.775591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:38.777190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:38.790384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25259f08-cf44-4928-a746-e56ab52a82f0 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:38.795013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:38.795638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:38.795969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:38.796239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] PATH_INFO: `/v3/projects/4cc4fecab91b42d3bede018c959724c6` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:38.797462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc4fecab91b42d3bede018c959724c6)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:38.799415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:38.959915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc4fecab91b42d3bede018c959724c6', 'request_id': 'req-ab679bca-2910-46e1-9e89-9763f3bc3af0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:39.047371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc4fecab91b42d3bede018c959724c6', 'request_id': 'req-ab679bca-2910-46e1-9e89-9763f3bc3af0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:39.053559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc4fecab91b42d3bede018c959724c6', 'request_id': 'req-ab679bca-2910-46e1-9e89-9763f3bc3af0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:39.065996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] The token cache is being invalidate because project 4cc4fecab91b42d3bede018c959724c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:02:39.066279 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:39.066946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ab679bca-2910-46e1-9e89-9763f3bc3af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:02:39.068384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1221/2447] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:02:38 2022] DELETE /identity/v3/projects/4cc4fecab91b42d3bede018c959724c6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:39.073931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58229d7-a5aa-495e-bb60-8579fea8115f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.074477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58229d7-a5aa-495e-bb60-8579fea8115f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.074602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58229d7-a5aa-495e-bb60-8579fea8115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.096156 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f58229d7-a5aa-495e-bb60-8579fea8115f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:39.097377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f58229d7-a5aa-495e-bb60-8579fea8115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:39.156227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1227/2448] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:39.164864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b15d8-6aa7-42c0-ae15-c32ed8e93f36 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.165143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b15d8-6aa7-42c0-ae15-c32ed8e93f36 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.165407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b15d8-6aa7-42c0-ae15-c32ed8e93f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.184583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-628b15d8-6aa7-42c0-ae15-c32ed8e93f36 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:39.185755 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-628b15d8-6aa7-42c0-ae15-c32ed8e93f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:39.194930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1222/2449] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:39.199174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58229d7-a5aa-495e-bb60-8579fea8115f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:39.210885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58229d7-a5aa-495e-bb60-8579fea8115f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.215708 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.216308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.216585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.216856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.217496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:02:39.217797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.219452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.231490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1228/2450] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:02:39.237788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b15d8-6aa7-42c0-ae15-c32ed8e93f36 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:39.247249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b15d8-6aa7-42c0-ae15-c32ed8e93f36 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.253919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.253919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.253919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.253919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.254479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.256267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.360918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1223/2451] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:39 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:39.365864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:39.375640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529f445-22b9-4cf3-b777-5d0e9b1aeb7f admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.433565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.434209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.434494 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.434821 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.435455 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.437371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.527424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1229/2452] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:39 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:39.531498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:39.541743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f69ae-9e1f-4df4-bbee-ea8f7692489d admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.546316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.546927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.547202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.547470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.548104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.549685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.554733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:39.560249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1224/2453] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:39.564427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:39.575398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0d352-8b2b-40cc-a88c-5e9b19aad660 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.580017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d77f1-d303-4855-b15e-7cfccd3bddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.580625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d77f1-d303-4855-b15e-7cfccd3bddea admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.580900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d77f1-d303-4855-b15e-7cfccd3bddea admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.581166 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d77f1-d303-4855-b15e-7cfccd3bddea admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.581792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d77f1-d303-4855-b15e-7cfccd3bddea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.583416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d77f1-d303-4855-b15e-7cfccd3bddea admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.593996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1230/2454] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:39.598826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:39.609045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857a6a2-a0f3-4cec-9505-6aaa374f40b6 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.614594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.615274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.617988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.617988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] PATH_INFO: `/v3/projects/5792f44387e140ab91839982507b7086/users/ffd4aca22cdc496aac1e51905a29ad43/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.630764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5792f44387e140ab91839982507b7086, user_id=ffd4aca22cdc496aac1e51905a29ad43, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.633429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.716428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1225/2455] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:39 2022] PUT /identity/v3/projects/5792f44387e140ab91839982507b7086/users/ffd4aca22cdc496aac1e51905a29ad43/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:39.722971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc81a17-fc79-4b04-8057-3887023823f8 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.723310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc81a17-fc79-4b04-8057-3887023823f8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.723585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc81a17-fc79-4b04-8057-3887023823f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.743706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-8cc81a17-fc79-4b04-8057-3887023823f8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:39.744914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8cc81a17-fc79-4b04-8057-3887023823f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:39.807336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1231/2456] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:39.817519 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:39.819341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:39.879250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef5268-a99c-46af-96dd-76398a71d9d1 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:39.882871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:39.883557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:39.883787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:39.884050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:39.893779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:39.901638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:39.906956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1226/2457] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:02:40.393334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:41.343104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c761-a0ee-45c3-9d1c-3e516f515adb None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:41.343104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c761-a0ee-45c3-9d1c-3e516f515adb None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:41.343104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845c761-a0ee-45c3-9d1c-3e516f515adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:41.374931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6845c761-a0ee-45c3-9d1c-3e516f515adb None None] MFA Rules not processed for user `ffd4aca22cdc496aac1e51905a29ad43`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:41.376161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6845c761-a0ee-45c3-9d1c-3e516f515adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:41.448654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1232/2458] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:41.453229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:41.463817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc3669-29d4-4e12-a8e1-8c2f8727efe3 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:41.468439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:41.469105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:41.469377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:41.469645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:41.470268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:41.472845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:41.565636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1227/2459] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:02:41 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:02:41.569701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845c761-a0ee-45c3-9d1c-3e516f515adb None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:41.581853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845c761-a0ee-45c3-9d1c-3e516f515adb None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:41.640236 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:41.640903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:41.641232 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:41.641529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:41.642157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:41.644618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:41.714573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1233/2460] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:02:41 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:02:41.718522 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:41.729338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cc121-502c-472c-86fa-032ec841a0d2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:41.734642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:41.735293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:41.740788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:41.740788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:41.740788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:41.740788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:41.750455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1228/2461] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:41.755058 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:41.766114 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66eeb4-2626-4f6f-8de1-1908f8953d71 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:41.771533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:41.772213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:41.772473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:41.772747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] PATH_INFO: `/v3/projects/a923409e08f6451e86611385a2957097/users/878658e541a24c2bbd5c49e13408dd35/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:41.788977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a923409e08f6451e86611385a2957097, user_id=878658e541a24c2bbd5c49e13408dd35, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:41.791962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:41.894513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1234/2462] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:41 2022] PUT /identity/v3/projects/a923409e08f6451e86611385a2957097/users/878658e541a24c2bbd5c49e13408dd35/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:41.898710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:41.909267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d9f8-ef6e-4cb7-8301-e05fc042dbcf admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:41.972355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bad08-7faf-4eef-9f44-f255909ec918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:41.972907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bad08-7faf-4eef-9f44-f255909ec918 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:41.973184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bad08-7faf-4eef-9f44-f255909ec918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:41.973453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bad08-7faf-4eef-9f44-f255909ec918 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:41.974098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bad08-7faf-4eef-9f44-f255909ec918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:41.975853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bad08-7faf-4eef-9f44-f255909ec918 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:41.987012 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1229/2463] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:02:41.991439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:42.002180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb55c9-fd22-49f3-b7a7-771ae78c8e5a admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:42.007685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad4c4-a3a8-48bb-8fe7-0f600a86a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:42.008435 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad4c4-a3a8-48bb-8fe7-0f600a86a453 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:42.008777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad4c4-a3a8-48bb-8fe7-0f600a86a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:42.009117 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad4c4-a3a8-48bb-8fe7-0f600a86a453 admin admin] PATH_INFO: `/v3/projects/a923409e08f6451e86611385a2957097/users/878658e541a24c2bbd5c49e13408dd35/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:42.011139 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad4c4-a3a8-48bb-8fe7-0f600a86a453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a923409e08f6451e86611385a2957097, user_id=878658e541a24c2bbd5c49e13408dd35, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:42.014195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad4c4-a3a8-48bb-8fe7-0f600a86a453 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:42.026783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1235/2464] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:02:41 2022] PUT /identity/v3/projects/a923409e08f6451e86611385a2957097/users/878658e541a24c2bbd5c49e13408dd35/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:02:44.454705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.455252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.455379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.488252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] MFA Rules not processed for user `878658e541a24c2bbd5c49e13408dd35`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:44.489786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:44.524689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:44.579052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1230/2465] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:44.590926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e8f2-2b05-43a4-8f4f-71de05cd14c5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.591491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e8f2-2b05-43a4-8f4f-71de05cd14c5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.591491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155e8f2-2b05-43a4-8f4f-71de05cd14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.612837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4155e8f2-2b05-43a4-8f4f-71de05cd14c5 None None] MFA Rules not processed for user `ffd4aca22cdc496aac1e51905a29ad43`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:44.614444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4155e8f2-2b05-43a4-8f4f-71de05cd14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:44.655038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:44.689601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1236/2466] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:02:44.701268 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:02:44.702711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:44.778535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822c60d-80c8-4551-843d-f1ea552c1fa9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:02:44.784193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:02:44.785290 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:44.785562 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:44.785826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:44.793852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:02:44.795498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:02:44.805386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1231/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:02:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:02:55.133487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=50 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:55.330202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=9 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:56.729167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e0824-1d1a-425d-bc0a-4b83bec31c7b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:02:56.729785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e0824-1d1a-425d-bc0a-4b83bec31c7b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:02:56.729785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e0824-1d1a-425d-bc0a-4b83bec31c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:02:56.750195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a92e0824-1d1a-425d-bc0a-4b83bec31c7b None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:02:56.751467 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a92e0824-1d1a-425d-bc0a-4b83bec31c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:02:56.809443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1237/2468] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:02:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:03:06.802744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=25 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:18.501845 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:18.598999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebf188-3e5f-44a7-82c9-9a4fd8a3eedb service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:18.606046 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:18.606959 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:18.607314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:18.607721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] PATH_INFO: `/v3/users/ffd4aca22cdc496aac1e51905a29ad43` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:18.609214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd4aca22cdc496aac1e51905a29ad43)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:18.612002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:18.906225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd4aca22cdc496aac1e51905a29ad43'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.010895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd4aca22cdc496aac1e51905a29ad43'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.024493 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd4aca22cdc496aac1e51905a29ad43'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.025225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd4aca22cdc496aac1e51905a29ad43'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.033087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd4aca22cdc496aac1e51905a29ad43'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.039760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1232/2469] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:03:18 2022] DELETE /identity/v3/users/ffd4aca22cdc496aac1e51905a29ad43 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:19.352908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e0824-1d1a-425d-bc0a-4b83bec31c7b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:19.369351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e0824-1d1a-425d-bc0a-4b83bec31c7b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:19.459037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:19.460319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:19.460599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:19.460868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] PATH_INFO: `/v3/projects/5792f44387e140ab91839982507b7086` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:19.463956 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5792f44387e140ab91839982507b7086)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:19.469550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:19.643432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5792f44387e140ab91839982507b7086', 'request_id': 'req-50e98461-365a-4439-ab41-ca3221b75af4'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.709099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5792f44387e140ab91839982507b7086', 'request_id': 'req-50e98461-365a-4439-ab41-ca3221b75af4'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.716567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5792f44387e140ab91839982507b7086', 'request_id': 'req-50e98461-365a-4439-ab41-ca3221b75af4'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.728896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] The token cache is being invalidate because project 5792f44387e140ab91839982507b7086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:03:19.729193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.729858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:19.731567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1238/2470] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:19 2022] DELETE /identity/v3/projects/5792f44387e140ab91839982507b7086 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:19.735414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:19.736858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:19.750262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7da7-7444-41b9-96e9-33fda225c0ce admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:19.818193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:19.818935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:19.819367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:19.819637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] PATH_INFO: `/v3/users/878658e541a24c2bbd5c49e13408dd35` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:19.821343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878658e541a24c2bbd5c49e13408dd35)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:19.822875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:19.850508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:20.059890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878658e541a24c2bbd5c49e13408dd35'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.167501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878658e541a24c2bbd5c49e13408dd35'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.185431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878658e541a24c2bbd5c49e13408dd35'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.191965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878658e541a24c2bbd5c49e13408dd35'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.194182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878658e541a24c2bbd5c49e13408dd35'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.210576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1233/2471] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:03:19 2022] DELETE /identity/v3/users/878658e541a24c2bbd5c49e13408dd35 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:20.550397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:03:20.551904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:03:20.576215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e98461-365a-4439-ab41-ca3221b75af4 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:03:20.650574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:03:20.651248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:03:20.651527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:03:20.651792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] PATH_INFO: `/v3/projects/a923409e08f6451e86611385a2957097` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:03:20.652918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a923409e08f6451e86611385a2957097)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:03:20.654924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:03:20.744557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:20.758273 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a923409e08f6451e86611385a2957097', 'request_id': 'req-e8aec9c2-d923-4008-8c33-d638ee117f41'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.830722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a923409e08f6451e86611385a2957097', 'request_id': 'req-e8aec9c2-d923-4008-8c33-d638ee117f41'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.838022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a923409e08f6451e86611385a2957097', 'request_id': 'req-e8aec9c2-d923-4008-8c33-d638ee117f41'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.849590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] The token cache is being invalidate because project a923409e08f6451e86611385a2957097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:03:20.849879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.850546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-e8aec9c2-d923-4008-8c33-d638ee117f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:03:20.852086 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1239/2472] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:20 2022] DELETE /identity/v3/projects/a923409e08f6451e86611385a2957097 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:03:30.208127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:30.885345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:02.820587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:02.823013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:02.975541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebca73-358f-4648-9c2c-6a0815d5e681 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:03.067066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:03.067763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:03.069317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:03.069317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:03.070840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:03.091346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:03.092984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:03.106643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1234/2473] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:06.173548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6cac-13c8-4a53-904e-fe775a96c870 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:06.174103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6cac-13c8-4a53-904e-fe775a96c870 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:06.174103 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6cac-13c8-4a53-904e-fe775a96c870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:06.198437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e7bd6cac-13c8-4a53-904e-fe775a96c870 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:06.200075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e7bd6cac-13c8-4a53-904e-fe775a96c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:06.271539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1240/2474] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:04:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:13.099551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=67 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:16.264129 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=25 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:27.561605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:27.563161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:27.630729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d1f3-cfbb-42f9-8a45-a5aaee388dd6 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:27.635382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:27.636011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:27.636286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:27.636554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] PATH_INFO: `/v3/users/27e89f049fa2413c88188fa13c9f4d57` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:27.637669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e89f049fa2413c88188fa13c9f4d57)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:27.639630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:27.821004 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e89f049fa2413c88188fa13c9f4d57'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:27.873878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e89f049fa2413c88188fa13c9f4d57'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:27.887859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e89f049fa2413c88188fa13c9f4d57'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:27.888594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e89f049fa2413c88188fa13c9f4d57'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:27.896063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e89f049fa2413c88188fa13c9f4d57'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:27.902574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1235/2475] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:04:27 2022] DELETE /identity/v3/users/27e89f049fa2413c88188fa13c9f4d57 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:27.907246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:27.907783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:27.907783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:27.927774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:27.928982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:27.990581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1241/2476] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:28.000223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:28.001636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:28.062174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f309301-891c-490f-a03b-a27a87bcd805 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:28.066275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:28.066907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:28.072234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:28.072234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:28.077032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:28.078470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:28.088331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1236/2477] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:28.375043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:28.376486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:28.392939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1db6e1-14fd-4268-afe9-585a19bb3933 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:28.398070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:28.399044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:28.399044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:28.399485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] PATH_INFO: `/v3/projects/fea74ec1cef84d5d8533684dc2ea706f` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:28.400678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea74ec1cef84d5d8533684dc2ea706f)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:28.403522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:28.505581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea74ec1cef84d5d8533684dc2ea706f', 'request_id': 'req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.584633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea74ec1cef84d5d8533684dc2ea706f', 'request_id': 'req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.591323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea74ec1cef84d5d8533684dc2ea706f', 'request_id': 'req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.603053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] The token cache is being invalidate because project fea74ec1cef84d5d8533684dc2ea706f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:04:28.603337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.604112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.605474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1242/2478] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:04:28 2022] DELETE /identity/v3/projects/fea74ec1cef84d5d8533684dc2ea706f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:28.609602 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:28.621098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf168e8-79b8-4152-9cb0-314bfe3e48eb service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:28.640590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:28.678697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:28.679359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:28.679633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:28.679899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] PATH_INFO: `/v3/users/42d3d40e29394f5896421858b023c5d9` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:28.681067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d3d40e29394f5896421858b023c5d9)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:28.683542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:28.878574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d3d40e29394f5896421858b023c5d9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.942329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d3d40e29394f5896421858b023c5d9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.955735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d3d40e29394f5896421858b023c5d9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.956763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d3d40e29394f5896421858b023c5d9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.964756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d662df84-9eb4-4832-8fd6-3a7db768f356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d3d40e29394f5896421858b023c5d9'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:28.971011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1237/2479] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:04:28 2022] DELETE /identity/v3/users/42d3d40e29394f5896421858b023c5d9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:04:29.495000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:04:29.497290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:29.514204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a8612-94fe-41f7-a54c-b987e4c6d9cb admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:04:29.579736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:04:29.580530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:29.580857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:29.581190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] PATH_INFO: `/v3/projects/bc1ca83a85b44586b26265c0bca3a9ce` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:29.582498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1ca83a85b44586b26265c0bca3a9ce)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:04:29.584530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:04:29.681240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:29.698358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1ca83a85b44586b26265c0bca3a9ce', 'request_id': 'req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:29.801929 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1ca83a85b44586b26265c0bca3a9ce', 'request_id': 'req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:29.807943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1ca83a85b44586b26265c0bca3a9ce', 'request_id': 'req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:29.819757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] The token cache is being invalidate because project bc1ca83a85b44586b26265c0bca3a9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:04:29.820048 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:29.820787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:04:29.822286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1243/2480] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:04:29 2022] DELETE /identity/v3/projects/bc1ca83a85b44586b26265c0bca3a9ce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:04:38.967468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:39.885488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:40.265332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7070e-0635-44d3-ba17-a2854e9a8efc None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:04:40.265868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7070e-0635-44d3-ba17-a2854e9a8efc None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:04:40.265868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7070e-0635-44d3-ba17-a2854e9a8efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:04:40.285516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-36d7070e-0635-44d3-ba17-a2854e9a8efc None None] MFA Rules not processed for user `4ba52b5b8b6f405396182116a4703a58`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:04:40.286756 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-36d7070e-0635-44d3-ba17-a2854e9a8efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:04:40.343738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1238/2481] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:04:50.338378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=25 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:05.755105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:05:05.758709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:05.855216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53cee1-f70d-4fd4-ac71-7f6d3c826a78 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:05:05.862698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1107ca-16bf-4243-9042-252f08e0fb83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:05:05.863583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1107ca-16bf-4243-9042-252f08e0fb83 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:05.863861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1107ca-16bf-4243-9042-252f08e0fb83 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:05.864158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1107ca-16bf-4243-9042-252f08e0fb83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:05.865934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4b1107ca-16bf-4243-9042-252f08e0fb83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:05.879027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1107ca-16bf-4243-9042-252f08e0fb83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:05:05.880396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1107ca-16bf-4243-9042-252f08e0fb83 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:05:05.895088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1244/2482] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:05:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:15.436940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:05:15.436940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:05:15.436940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:05:15.451332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:05:15.452548 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:05:15.512998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1239/2483] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:05:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:05:15.889180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=32 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:25.506349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=25 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:14.184881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:14.185508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:14.185508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:14.207419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:06:14.208579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:14.215563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1245/2484] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:06:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:06:20.658052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:20.659579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:20.768209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff03f2-56cf-43ef-a8ca-f7ace7e20192 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:20.773927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:20.774557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:20.774861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:20.775132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:20.776879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:20.788641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:20.790240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:20.799503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1240/2485] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:23.246113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:23.248095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:23.312627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46c9ae-338d-4c33-a041-41f188a28193 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:23.317864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:23.317864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:23.317864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:23.317864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:23.319833 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:23.334803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:23.336252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:23.349063 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1246/2486] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:06:24.545408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:24.552148 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21309f-dc4d-4e36-ab1d-8447d77e643d service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:24.555905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:24.556579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:24.556887 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:24.557155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:24.558956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:24.573531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:24.575008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:24.587342 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1241/2487] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:28.745971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:06:28.747393 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:28.758701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb799b-d97e-4573-95f4-0ea4e9182f4f service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:06:28.762604 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:06:28.763219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:06:28.763488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:06:28.763748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:06:28.765481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:06:28.828599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:06:28.830179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:06:28.840496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1247/2488] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:06:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:06:34.582036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=52 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:38.835922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=59 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:03.509462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:03.517893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089a85c-d597-48c8-8452-1461b12b4d97 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:03.522761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:03.522761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:03.522761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:03.522761 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:03.524432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:03.534094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:03.535656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:03.544137 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1242/2489] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:04.748183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:04.749580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:04.825876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ccae6-7cc9-40d5-ad13-670bfe387e38 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:04.829541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b18f309b5cb4641997b637f8f17ac87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:04.830136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:04.830414 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:04.830752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:04.832469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:04.843805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:04.845251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:04.854934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1248/2490] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:06.423342 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:06.426186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:06.445465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32af4-3612-4f6a-ae4e-5bb40bf28c7f service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:06.452891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ee780-86cd-4314-b787-82b6f41794d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:06.453776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ee780-86cd-4314-b787-82b6f41794d3 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:06.454065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ee780-86cd-4314-b787-82b6f41794d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:06.454446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ee780-86cd-4314-b787-82b6f41794d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:06.456673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-457ee780-86cd-4314-b787-82b6f41794d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:06.473108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ee780-86cd-4314-b787-82b6f41794d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:06.475296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ee780-86cd-4314-b787-82b6f41794d3 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:06.489970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1243/2491] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:14.849987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=35 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:16.483574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=12 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:16.833139 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:16.849237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257743f-a99c-424c-8d6d-8e18c090f344 service cinder] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:16.855630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:16.856227 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:16.856643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:16.856918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:16.859002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:16.873505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:16.875179 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:16.885791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1249/2492] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:26.882022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:28.120675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa239a-cd9e-4882-b713-48f2cd49a6bb None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:28.121214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa239a-cd9e-4882-b713-48f2cd49a6bb None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:28.121214 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa239a-cd9e-4882-b713-48f2cd49a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:28.141087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-73aa239a-cd9e-4882-b713-48f2cd49a6bb None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:28.142270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-73aa239a-cd9e-4882-b713-48f2cd49a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:28.149790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1244/2493] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:07:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:28.371928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:28.383599 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1406a-dc87-4904-9caa-2b35f4c78977 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:28.387787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1708d8-d91e-4139-8b46-abf099bdca25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:28.388094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1708d8-d91e-4139-8b46-abf099bdca25 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:28.388574 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1708d8-d91e-4139-8b46-abf099bdca25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:28.389078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1708d8-d91e-4139-8b46-abf099bdca25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:28.391150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cd1708d8-d91e-4139-8b46-abf099bdca25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:28.405700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1708d8-d91e-4139-8b46-abf099bdca25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:28.407717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1708d8-d91e-4139-8b46-abf099bdca25 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:28.418190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1250/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:29.018121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3fb62-dc28-4a7d-8ff6-91125aa0dfab None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.018470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3fb62-dc28-4a7d-8ff6-91125aa0dfab None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.018778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3fb62-dc28-4a7d-8ff6-91125aa0dfab None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.020157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1245/2495] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 10:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:07:29.026292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3af7-941f-4db8-a703-ee8bb8414fb5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.026689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3af7-941f-4db8-a703-ee8bb8414fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.027066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc3af7-941f-4db8-a703-ee8bb8414fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.078187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1bbc3af7-941f-4db8-a703-ee8bb8414fb5 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:29.079421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1bbc3af7-941f-4db8-a703-ee8bb8414fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:29.089794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1251/2496] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:07:29.100343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3fb62-dc28-4a7d-8ff6-91125aa0dfab None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.112032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3fb62-dc28-4a7d-8ff6-91125aa0dfab None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.115518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834a90d-e5d6-4ddf-9580-b56dd8ca1595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.116096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a90d-e5d6-4ddf-9580-b56dd8ca1595 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.116368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a90d-e5d6-4ddf-9580-b56dd8ca1595 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.116630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834a90d-e5d6-4ddf-9580-b56dd8ca1595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.126359 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a90d-e5d6-4ddf-9580-b56dd8ca1595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.127810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834a90d-e5d6-4ddf-9580-b56dd8ca1595 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.138066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1246/2497] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:29.201262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc3af7-941f-4db8-a703-ee8bb8414fb5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:29.213205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc3af7-941f-4db8-a703-ee8bb8414fb5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:29.218857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:29.219463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:29.219832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:29.220304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:29.221879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:29.234446 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:29.236094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:29.246631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1252/2498] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:30.560843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e2d60-3bf6-401b-baf0-f992b9b45282 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:30.561443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e2d60-3bf6-401b-baf0-f992b9b45282 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:30.561443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e2d60-3bf6-401b-baf0-f992b9b45282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:30.580975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-c23e2d60-3bf6-401b-baf0-f992b9b45282 None None] MFA Rules not processed for user `4ba52b5b8b6f405396182116a4703a58`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:30.582432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c23e2d60-3bf6-401b-baf0-f992b9b45282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:30.589173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1247/2499] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:30.910310 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:30.920304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87841085-7b9f-4623-b473-73e08ed64b10 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:30.924001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de36ec-c2b6-4f49-876d-32d13e30e3ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:30.924591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de36ec-c2b6-4f49-876d-32d13e30e3ed service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:30.924869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de36ec-c2b6-4f49-876d-32d13e30e3ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:30.925137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de36ec-c2b6-4f49-876d-32d13e30e3ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:30.926868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b0de36ec-c2b6-4f49-876d-32d13e30e3ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:30.937291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de36ec-c2b6-4f49-876d-32d13e30e3ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:30.938730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de36ec-c2b6-4f49-876d-32d13e30e3ed service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:30.946503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1253/2500] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:37.062470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e2d60-3bf6-401b-baf0-f992b9b45282 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:37.076800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e2d60-3bf6-401b-baf0-f992b9b45282 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:37.085183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:37.085999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:37.086281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:37.086550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:37.088772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:37.103346 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:37.104945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:37.119225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1248/2501] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:40.942997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=31 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:47.111701 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=18 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:50.024008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de764d-5ac2-4eec-b07b-997f41027127 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:50.024515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de764d-5ac2-4eec-b07b-997f41027127 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:50.024515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de764d-5ac2-4eec-b07b-997f41027127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:50.045445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d6de764d-5ac2-4eec-b07b-997f41027127 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:07:50.046620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d6de764d-5ac2-4eec-b07b-997f41027127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:50.053382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1254/2502] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:07:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:07:54.741222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:54.751220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a40163-4b63-4717-9135-33c0ea71ce65 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:54.755177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25cab4-42d2-4fbd-89d7-ae875b426208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:54.757434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25cab4-42d2-4fbd-89d7-ae875b426208 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:54.757434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25cab4-42d2-4fbd-89d7-ae875b426208 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:54.757434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25cab4-42d2-4fbd-89d7-ae875b426208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:54.758841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2f25cab4-42d2-4fbd-89d7-ae875b426208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:54.823642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25cab4-42d2-4fbd-89d7-ae875b426208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:54.825072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25cab4-42d2-4fbd-89d7-ae875b426208 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:54.834556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1249/2503] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:07:56.987497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de764d-5ac2-4eec-b07b-997f41027127 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:07:57.001530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de764d-5ac2-4eec-b07b-997f41027127 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:07:57.007223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:07:57.007962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:07:57.008239 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:07:57.008510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:07:57.010302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:07:57.023547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:07:57.026379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:07:57.036495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1255/2504] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:07:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:08:04.830265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=30 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:07.032118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=9 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:24.394295 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055058-a1aa-4dbc-b189-8672ef0da71e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:08:24.394859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055058-a1aa-4dbc-b189-8672ef0da71e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:08:24.394859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e055058-a1aa-4dbc-b189-8672ef0da71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:08:24.414283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8e055058-a1aa-4dbc-b189-8672ef0da71e None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:08:24.415511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8e055058-a1aa-4dbc-b189-8672ef0da71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:08:24.422330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1250/2505] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:08:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:08:34.409344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:10.850910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:09:10.851804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:10.865857 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198be32-88a4-47b2-a351-6f92485aff5d service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:09:10.870841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:09:10.871430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:10.871707 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:10.871978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:10.873621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:10.885254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:09:10.890964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:09:10.897350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1256/2506] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:09:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:20.892459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:37.022974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33c51-ea9b-468e-9d1e-d51b01d71c0e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:09:37.023542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33c51-ea9b-468e-9d1e-d51b01d71c0e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:09:37.023542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d33c51-ea9b-468e-9d1e-d51b01d71c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:09:37.042868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-97d33c51-ea9b-468e-9d1e-d51b01d71c0e None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:09:37.044314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-97d33c51-ea9b-468e-9d1e-d51b01d71c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:09:37.051231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1251/2507] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:09:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:09:47.037712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:41.116545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:41.127431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26790c-e1f6-4ad3-8815-ad53477f98ac service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:41.131065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:41.131683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:41.131962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:41.132225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:41.134075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:41.201075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:41.202509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:41.212530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1257/2508] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:48.098114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33c51-ea9b-468e-9d1e-d51b01d71c0e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.111284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d33c51-ea9b-468e-9d1e-d51b01d71c0e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.120039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.120039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.120039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.120039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.127748 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.129329 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.139970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1252/2509] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:10:48.206806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.208256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:48.221861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c8cd8-3d60-4834-8a10-80ee4f50aacc service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.227721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.228766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.228766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.229008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] PATH_INFO: `/v3/users/4ba52b5b8b6f405396182116a4703a58` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.243846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba52b5b8b6f405396182116a4703a58)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.245784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.402811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba52b5b8b6f405396182116a4703a58'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.475254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba52b5b8b6f405396182116a4703a58'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.475806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba52b5b8b6f405396182116a4703a58'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.484007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba52b5b8b6f405396182116a4703a58'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.495816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba52b5b8b6f405396182116a4703a58'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.501781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1258/2510] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:48 2022] DELETE /identity/v3/users/4ba52b5b8b6f405396182116a4703a58 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:48.745783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.756599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871c78-7a45-48a8-8a54-ef5620ce7a81 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:48.813739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:48.814415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:48.814711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:48.814980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] PATH_INFO: `/v3/projects/076144e2070b434c9d1fda1223cff4ed` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:48.825646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076144e2070b434c9d1fda1223cff4ed)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:48.827587 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:48.909699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076144e2070b434c9d1fda1223cff4ed', 'request_id': 'req-87013ffa-9329-4558-ae3a-ac394b3c6e88'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.949133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076144e2070b434c9d1fda1223cff4ed', 'request_id': 'req-87013ffa-9329-4558-ae3a-ac394b3c6e88'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.954707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076144e2070b434c9d1fda1223cff4ed', 'request_id': 'req-87013ffa-9329-4558-ae3a-ac394b3c6e88'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.966350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] The token cache is being invalidate because project 076144e2070b434c9d1fda1223cff4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:48.966676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.967306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:48.968769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1253/2511] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:48 2022] DELETE /identity/v3/projects/076144e2070b434c9d1fda1223cff4ed => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:48.972815 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:48.974229 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:48.987386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e14f4d-3f3b-4b0b-ad1a-71b1c2b3d51f admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:49.037107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:49.043253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:49.043904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:49.044183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:49.044455 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] PATH_INFO: `/v3/users/85c7dc344c8f48989fa9c48d94414fe1` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:49.057986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c7dc344c8f48989fa9c48d94414fe1)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:49.059952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:49.243840 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c7dc344c8f48989fa9c48d94414fe1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.309668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c7dc344c8f48989fa9c48d94414fe1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.310279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c7dc344c8f48989fa9c48d94414fe1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.317558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c7dc344c8f48989fa9c48d94414fe1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.330181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c7dc344c8f48989fa9c48d94414fe1'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.336190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1259/2512] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:10:48 2022] DELETE /identity/v3/users/85c7dc344c8f48989fa9c48d94414fe1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:49.574154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:10:49.575632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:10:49.588687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013ffa-9329-4558-ae3a-ac394b3c6e88 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:10:49.647390 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:10:49.648151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:10:49.648452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:10:49.648709 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] PATH_INFO: `/v3/projects/0a25ffaef1b74d34b52eff683648c46a` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:10:49.659632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a25ffaef1b74d34b52eff683648c46a)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:10:49.661569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:10:49.662956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:49.761668 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a25ffaef1b74d34b52eff683648c46a', 'request_id': 'req-dc9cbbee-bc71-4cfb-9220-ecb05994be63'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.824053 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a25ffaef1b74d34b52eff683648c46a', 'request_id': 'req-dc9cbbee-bc71-4cfb-9220-ecb05994be63'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.829895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a25ffaef1b74d34b52eff683648c46a', 'request_id': 'req-dc9cbbee-bc71-4cfb-9220-ecb05994be63'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.842312 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] The token cache is being invalidate because project 0a25ffaef1b74d34b52eff683648c46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:10:49.842591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.843410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:10:49.844916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1254/2513] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:10:49 2022] DELETE /identity/v3/projects/0a25ffaef1b74d34b52eff683648c46a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:10:59.332634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:59.839299 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:48.540527 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:11:48.541965 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:48.648603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e0d73-3b62-4f50-8ac4-0bb9a634ed93 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:11:48.697075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:11:48.697678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:11:48.697950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:11:48.698215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:11:48.699984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:11:48.779240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:48.791933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:11:48.793352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:11:48.813142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1260/2514] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:11:58.810031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=9 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:08.486829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:08.488331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:08.503124 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cbbee-bc71-4cfb-9220-ecb05994be63 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:08.506693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:08.507317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:08.507594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:08.507865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:08.509543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:08.519165 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:08.520594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:08.528507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1255/2515] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:18.524966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=8 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:33.069065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:33.071189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:33.162256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafa7d2-c0e5-48dc-b3b2-317e81dbfea3 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:33.167831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:33.168430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:33.168706 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:33.168974 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:33.170716 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:33.183484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:33.185173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:33.197102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1261/2516] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:33.504166 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:33.505787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:33.516397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faa720-3f11-4b67-b3c4-ab5ab57122bf service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:33.520114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:33.520697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:33.520966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:33.521423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:33.523118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:33.538062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:33.539526 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:33.551169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1256/2517] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:34.742959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:34.753541 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22269f-e137-48e4-aa42-b578893e9dc8 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:34.757057 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214eb4-78aa-4ad8-9fcf-07c455fd789c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:34.757637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214eb4-78aa-4ad8-9fcf-07c455fd789c service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:34.757908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214eb4-78aa-4ad8-9fcf-07c455fd789c service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:34.758174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214eb4-78aa-4ad8-9fcf-07c455fd789c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:34.759882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fe214eb4-78aa-4ad8-9fcf-07c455fd789c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:34.772758 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe214eb4-78aa-4ad8-9fcf-07c455fd789c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:34.774149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe214eb4-78aa-4ad8-9fcf-07c455fd789c service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:34.785174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1262/2518] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:42.978934 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:42.988183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b79fd7-0d30-4c66-bc71-314e922adc98 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:42.991833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:42.992450 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:42.992721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:42.992986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:42.994682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:43.088464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:43.089914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:43.109229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1257/2519] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:44.779982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=43 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:49.243989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:49.244616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:49.244616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:49.274589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:12:49.275855 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:49.284087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1263/2520] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:12:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:12:49.607921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:49.616441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cb942-1911-4b43-a56c-e093809690e5 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:49.620064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:49.620646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:49.620922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:49.621187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:49.622928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:49.632090 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:49.633515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:49.641542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1258/2521] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:52.060000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:12:52.061373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:52.130639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810586-303f-43ad-a41e-d992a1c1a681 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:12:52.135589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:12:52.136189 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:12:52.136460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:12:52.136724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:12:52.138432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:12:52.150252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:12:52.151869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:12:52.162552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1264/2522] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:12:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:12:59.637813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=55 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:02.157492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=38 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:04.712598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:04.726484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c59b-e0d0-4334-99e4-5d6a0915bd8b service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:04.737187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0192b17-2766-44d1-a3da-a555b47d1fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:04.737187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192b17-2766-44d1-a3da-a555b47d1fc2 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:04.737187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192b17-2766-44d1-a3da-a555b47d1fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:04.737187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192b17-2766-44d1-a3da-a555b47d1fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:04.737713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a0192b17-2766-44d1-a3da-a555b47d1fc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:04.747828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0192b17-2766-44d1-a3da-a555b47d1fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:04.749471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0192b17-2766-44d1-a3da-a555b47d1fc2 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:04.760651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1259/2523] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:10.585553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:13:10.586988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:10.604540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611833d-ae22-48cb-a7ec-0434bd8df8f1 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:13:10.610777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:13:10.611443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:10.612082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:10.612195 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:10.614362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:10.627374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:13:10.629046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:13:10.641383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1265/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:13:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:13:13.216352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:13:13.216826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:13:13.216918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:13:13.236600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:13:13.237950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:13:13.246823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1260/2525] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:13:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:13:20.636013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:23.231721 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=9 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:12.884882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:12.906762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0996fa6-91f9-4385-8da5-271d7faf2445 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:12.911850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887ef93-146a-49ba-a16c-16684a652a85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:12.912436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ef93-146a-49ba-a16c-16684a652a85 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:12.912736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ef93-146a-49ba-a16c-16684a652a85 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:12.913001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887ef93-146a-49ba-a16c-16684a652a85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:12.914786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5887ef93-146a-49ba-a16c-16684a652a85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:12.939213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887ef93-146a-49ba-a16c-16684a652a85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:12.940786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887ef93-146a-49ba-a16c-16684a652a85 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:12.951395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1266/2526] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:22.946392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=15 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:28.708549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:14:28.709928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:28.724945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cab0cb-06e0-49ec-bbce-b25300c6b289 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:14:28.730432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:14:28.731065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:28.731372 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:28.732207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:28.734126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:28.745834 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:14:28.747477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:14:28.757422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1261/2527] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:14:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:14:37.787479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479531e-1b9c-4546-a0c6-f482bd0e3add None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:14:37.787966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479531e-1b9c-4546-a0c6-f482bd0e3add None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:14:37.788070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479531e-1b9c-4546-a0c6-f482bd0e3add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:14:37.806646 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e479531e-1b9c-4546-a0c6-f482bd0e3add None None] MFA Rules not processed for user `0949a6af053443818fdac57ad82e81b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:14:37.807856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e479531e-1b9c-4546-a0c6-f482bd0e3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:14:37.815104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1267/2528] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:14:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:14:38.753077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:47.801408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:43.931962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:43.933554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:44.034423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7615-3aa9-4fa1-9cf8-c69aae09832e service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:44.041076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:44.041657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:44.041936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:44.042210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] PATH_INFO: `/v3/users/0949a6af053443818fdac57ad82e81b0` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:44.043379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0949a6af053443818fdac57ad82e81b0)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:44.045443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:44.228724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0949a6af053443818fdac57ad82e81b0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.279985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0949a6af053443818fdac57ad82e81b0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.292356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0949a6af053443818fdac57ad82e81b0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.292925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0949a6af053443818fdac57ad82e81b0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.300486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0949a6af053443818fdac57ad82e81b0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.306484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1262/2529] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:15:43 2022] DELETE /identity/v3/users/0949a6af053443818fdac57ad82e81b0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:44.311140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438478-4059-44b9-afee-373a1edde003 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:44.312200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438478-4059-44b9-afee-373a1edde003 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:44.312309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438478-4059-44b9-afee-373a1edde003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:44.339894 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-03438478-4059-44b9-afee-373a1edde003 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:44.341237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-03438478-4059-44b9-afee-373a1edde003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:44.398681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1268/2530] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:44.409790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:44.411729 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:44.467195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba58ea3-104d-48e8-b5b0-4d423b97be66 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:44.471250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:44.471838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:44.472109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:44.472369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:44.478202 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:44.481888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:44.483911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:44.493074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1263/2531] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:15:44.708316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438478-4059-44b9-afee-373a1edde003 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:44.710785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-03438478-4059-44b9-afee-373a1edde003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:44.725893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438478-4059-44b9-afee-373a1edde003 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:44.731952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:44.731952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:44.732276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:44.732576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] PATH_INFO: `/v3/projects/0d399d550dab41259d95623249c98b71` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:44.734566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d399d550dab41259d95623249c98b71)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:44.736500 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:44.854567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d399d550dab41259d95623249c98b71', 'request_id': 'req-ad3c53d4-ceec-4198-bd94-2e94dd70342c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.920040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d399d550dab41259d95623249c98b71', 'request_id': 'req-ad3c53d4-ceec-4198-bd94-2e94dd70342c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.925703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d399d550dab41259d95623249c98b71', 'request_id': 'req-ad3c53d4-ceec-4198-bd94-2e94dd70342c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.936962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] The token cache is being invalidate because project 0d399d550dab41259d95623249c98b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:15:44.937246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.937868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:44.939375 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1269/2532] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:15:44 2022] DELETE /identity/v3/projects/0d399d550dab41259d95623249c98b71 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:44.943599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:44.953942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e03731-dac1-4c15-8f47-3f59aa0fb117 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:45.010659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:45.011233 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:45.011506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:45.011793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] PATH_INFO: `/v3/users/7c5f46201fa14176ba942f182245be9b` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:45.012904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5f46201fa14176ba942f182245be9b)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:45.015424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:45.212253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5f46201fa14176ba942f182245be9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.297244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5f46201fa14176ba942f182245be9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.309760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5f46201fa14176ba942f182245be9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.310399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5f46201fa14176ba942f182245be9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.318252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3956dec7-1bf8-494a-8298-c17bca9301bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5f46201fa14176ba942f182245be9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:45.324344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1264/2533] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:15:44 2022] DELETE /identity/v3/users/7c5f46201fa14176ba942f182245be9b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:45.761744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:45.763209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:45.777008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c53d4-ceec-4198-bd94-2e94dd70342c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:45.836252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:45.836876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:45.837150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:45.837425 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] PATH_INFO: `/v3/projects/6bae85ff2f97408eb7f162001b44a5a8` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:45.838533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bae85ff2f97408eb7f162001b44a5a8)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:45.840490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:45.862495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:45.931148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bae85ff2f97408eb7f162001b44a5a8', 'request_id': 'req-0755714b-4dbf-4f38-b349-ec0844d2c354'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.034565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bae85ff2f97408eb7f162001b44a5a8', 'request_id': 'req-0755714b-4dbf-4f38-b349-ec0844d2c354'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.040560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bae85ff2f97408eb7f162001b44a5a8', 'request_id': 'req-0755714b-4dbf-4f38-b349-ec0844d2c354'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.051693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] The token cache is being invalidate because project 6bae85ff2f97408eb7f162001b44a5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:15:46.051977 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.052598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0755714b-4dbf-4f38-b349-ec0844d2c354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:15:46.054046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1270/2534] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:15:45 2022] DELETE /identity/v3/projects/6bae85ff2f97408eb7f162001b44a5a8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:51.747105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cc87e-1cff-4f11-a172-bda09f27dd15 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:51.747640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cc87e-1cff-4f11-a172-bda09f27dd15 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:51.747740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cc87e-1cff-4f11-a172-bda09f27dd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:51.797368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-540cc87e-1cff-4f11-a172-bda09f27dd15 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:51.798541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-540cc87e-1cff-4f11-a172-bda09f27dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:51.841143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:51.856509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1265/2535] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:51.867885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeacae-81bf-4c10-8c03-69dbaa66320f None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:51.868382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeacae-81bf-4c10-8c03-69dbaa66320f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:51.868480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeacae-81bf-4c10-8c03-69dbaa66320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:51.887788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-8baeacae-81bf-4c10-8c03-69dbaa66320f None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:51.888960 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8baeacae-81bf-4c10-8c03-69dbaa66320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:51.896797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1271/2536] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:51.901349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cc87e-1cff-4f11-a172-bda09f27dd15 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:51.911893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cc87e-1cff-4f11-a172-bda09f27dd15 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:51.916377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:51.916954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:51.917224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:51.917486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:51.918112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:15:51.918540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:51.920176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:51.932015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1266/2537] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:15:51.940205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeacae-81bf-4c10-8c03-69dbaa66320f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:51.949506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeacae-81bf-4c10-8c03-69dbaa66320f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:51.954352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:51.954992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:51.955266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:51.955532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:51.956162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:51.958046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.099208 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1272/2538] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:15:51 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:52.103491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.113950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739237f-26df-4b9f-b9fb-69b190c92d01 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.168388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.168977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.169249 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.169515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.170141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.172850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.272663 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1267/2539] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:15:52 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:52.276809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.287814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673694e1-dc21-4a8f-abfb-d10a02f7df65 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.292388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.293003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.293291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.293756 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.295216 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.296831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.306882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1273/2540] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:15:52.310833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.320999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bd1af-1ecf-4dcc-a4d1-5e4be9ba27de admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.325561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a72b35-1a67-44b6-961c-9cf2fc83bd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.326141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72b35-1a67-44b6-961c-9cf2fc83bd5c admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.326410 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72b35-1a67-44b6-961c-9cf2fc83bd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.329360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72b35-1a67-44b6-961c-9cf2fc83bd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.329360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a72b35-1a67-44b6-961c-9cf2fc83bd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.329360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a72b35-1a67-44b6-961c-9cf2fc83bd5c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.339713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1268/2541] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:15:52.344747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.354993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8ddbb-89e8-4be9-bc43-46c3ac2875dd admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.359654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.360652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.360652 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.360918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] PATH_INFO: `/v3/projects/ad8b75ab4ce94734a764726a1c13324f/users/71e77489ac024c07b55d4e0e0486bb44/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.375865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8b75ab4ce94734a764726a1c13324f, user_id=71e77489ac024c07b55d4e0e0486bb44, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.378584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.463427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1274/2542] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:15:52 2022] PUT /identity/v3/projects/ad8b75ab4ce94734a764726a1c13324f/users/71e77489ac024c07b55d4e0e0486bb44/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:15:52.476200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b7222-8d5f-42e6-9247-0c2df5782a04 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.476482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b7222-8d5f-42e6-9247-0c2df5782a04 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.476750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b7222-8d5f-42e6-9247-0c2df5782a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.503603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6f9b7222-8d5f-42e6-9247-0c2df5782a04 None None] MFA Rules not processed for user `71e77489ac024c07b55d4e0e0486bb44`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:52.504791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6f9b7222-8d5f-42e6-9247-0c2df5782a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:52.568659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1269/2543] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:52.573347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.635383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fc8bf-30b2-4879-bc5f-7ff1d71ba305 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.640665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.641250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.641521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.641785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.642398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.644335 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.721274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1275/2544] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:15:52 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:52.726723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b7222-8d5f-42e6-9247-0c2df5782a04 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.738208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b7222-8d5f-42e6-9247-0c2df5782a04 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.780049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:52.794289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.794913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.795190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.795457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.796139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.798080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.897971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1270/2545] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:15:52 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:15:52.901920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.912901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ab6ba-857f-4aec-a87c-e6b10f0463fd admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.917678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.918283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.918767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.919046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.919685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.922050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:52.932926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1276/2546] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:15:52.937194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:52.947050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198302ca-98f1-4900-a090-c365766ff094 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:52.951558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:52.956831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:52.956831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:52.956831 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] PATH_INFO: `/v3/projects/7c959b26191b4a99b60591092f8c5999/users/64886933c7bb4ddfb68138bf10923863/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:52.968496 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c959b26191b4a99b60591092f8c5999, user_id=64886933c7bb4ddfb68138bf10923863, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:52.971422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:53.056849 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1271/2547] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:15:52 2022] PUT /identity/v3/projects/7c959b26191b4a99b60591092f8c5999/users/64886933c7bb4ddfb68138bf10923863/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:15:53.060973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:53.071090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af476ded-7179-4f47-9606-224dfc142c48 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:53.075783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:53.125967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d787d70-5d44-404a-8525-cd1e3f3fe6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:53.126550 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d787d70-5d44-404a-8525-cd1e3f3fe6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:53.126852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d787d70-5d44-404a-8525-cd1e3f3fe6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:53.127118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d787d70-5d44-404a-8525-cd1e3f3fe6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:53.127738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d787d70-5d44-404a-8525-cd1e3f3fe6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:53.129311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d787d70-5d44-404a-8525-cd1e3f3fe6b0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:53.139233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1277/2548] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:15:53.143788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:53.154083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5683f-0f99-4286-a771-6c911934a9de admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:53.159466 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36436e-e233-45d4-9b1e-b6814f1fb939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:53.163557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36436e-e233-45d4-9b1e-b6814f1fb939 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:53.163557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36436e-e233-45d4-9b1e-b6814f1fb939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:53.163557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36436e-e233-45d4-9b1e-b6814f1fb939 admin admin] PATH_INFO: `/v3/projects/7c959b26191b4a99b60591092f8c5999/users/64886933c7bb4ddfb68138bf10923863/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:53.163557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36436e-e233-45d4-9b1e-b6814f1fb939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c959b26191b4a99b60591092f8c5999, user_id=64886933c7bb4ddfb68138bf10923863, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:53.165333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36436e-e233-45d4-9b1e-b6814f1fb939 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:53.175503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1272/2549] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:15:53 2022] PUT /identity/v3/projects/7c959b26191b4a99b60591092f8c5999/users/64886933c7bb4ddfb68138bf10923863/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:15:53.185581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:53.185865 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:53.186137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:53.214209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] MFA Rules not processed for user `64886933c7bb4ddfb68138bf10923863`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:53.215413 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:53.286816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1278/2550] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:53.300060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:53.302931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:53.302931 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:53.319814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] MFA Rules not processed for user `71e77489ac024c07b55d4e0e0486bb44`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:15:53.320997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:53.375917 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1273/2551] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:15:53.388932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:15:53.390969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:15:53.464429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3244-27e7-4525-a1c6-2b92467e7e35 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:15:53.470088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656284a3-5fb4-4bbe-9116-035bf2dcc4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:15:53.470705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656284a3-5fb4-4bbe-9116-035bf2dcc4bc service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:15:53.470985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656284a3-5fb4-4bbe-9116-035bf2dcc4bc service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:15:53.471250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656284a3-5fb4-4bbe-9116-035bf2dcc4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:15:53.479081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656284a3-5fb4-4bbe-9116-035bf2dcc4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:15:53.480671 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656284a3-5fb4-4bbe-9116-035bf2dcc4bc service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:15:53.489271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1279/2552] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:03.369227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=49,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:03.485863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=93 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:08.151196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:08.152600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:08.168034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbc1dd-064d-4e40-9bc0-78dc8e6fef29 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:08.173371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:08.174444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:08.174747 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:08.175015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:08.182909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:08.184481 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:08.194127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1274/2553] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:08.208810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762837-db1c-4819-87f7-db61d864291b None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:08.209217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762837-db1c-4819-87f7-db61d864291b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:08.209351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47762837-db1c-4819-87f7-db61d864291b None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:08.210740 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1280/2554] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 10:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:16:08.215081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] Authenticating service token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:16:08.226038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 28 10:16:08.226327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:08.234437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8628eb-5eca-4923-8f28-5ea3e7ba35c0 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:08.239556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64886933c7bb4ddfb68138bf10923863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c959b26191b4a99b60591092f8c5999', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:08.240143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:08.240418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:08.240686 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] PATH_INFO: `/v3/projects/7c959b26191b4a99b60591092f8c5999` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:08.241777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] RBAC: Authorizing `identity:get_project(project_id=7c959b26191b4a99b60591092f8c5999)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:08.243625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:08.245179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1275/2555] 10.222.0.49 () {58 vars in 1443 bytes} [Fri Oct 28 10:16:08 2022] GET /identity/v3/projects/7c959b26191b4a99b60591092f8c5999 => generated 393 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:16:08.706897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834757-8b65-4ef8-853a-f2693029f1f5 None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:08.707176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834757-8b65-4ef8-853a-f2693029f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:08.707445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94834757-8b65-4ef8-853a-f2693029f1f5 None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:08.708783 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1281/2556] 10.222.0.49 () {54 vars in 912 bytes} [Fri Oct 28 10:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:16:08.713619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] Authenticating service token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 28 10:16:08.727246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:08.736252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfab80-dffc-4032-b942-e0b6d46f689d tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:08.740551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64886933c7bb4ddfb68138bf10923863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c959b26191b4a99b60591092f8c5999', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:08.741154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:08.741432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:08.741720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] PATH_INFO: `/v3/projects/7c959b26191b4a99b60591092f8c5999` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:08.742944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] RBAC: Authorizing `identity:get_project(project_id=7c959b26191b4a99b60591092f8c5999)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:08.744782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:08.746478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1276/2557] 10.222.0.49 () {58 vars in 1443 bytes} [Fri Oct 28 10:16:08 2022] GET /identity/v3/projects/7c959b26191b4a99b60591092f8c5999 => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:16:08.958798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834757-8b65-4ef8-853a-f2693029f1f5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:08.960644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-94834757-8b65-4ef8-853a-f2693029f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:09.018995 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94834757-8b65-4ef8-853a-f2693029f1f5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:09.022384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623d7d0-2c75-4f28-afdb-751cafb1feb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:09.023011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d7d0-2c75-4f28-afdb-751cafb1feb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:09.023287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d7d0-2c75-4f28-afdb-751cafb1feb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:09.023557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623d7d0-2c75-4f28-afdb-751cafb1feb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:09.025298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6623d7d0-2c75-4f28-afdb-751cafb1feb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:09.035088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623d7d0-2c75-4f28-afdb-751cafb1feb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:09.036502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623d7d0-2c75-4f28-afdb-751cafb1feb4 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:09.044309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1282/2558] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:13.088121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:13.150381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82563bb8-a1e5-4de0-abde-c9a39fab6dbb tempest-ServersAdminNegativeTestJSON-1701918233 tempest-ServersAdminNegativeTestJSON-1701918233-project-admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:13.154940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:13.155561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:13.155837 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:13.156105 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] PATH_INFO: `/v3/users/71e77489ac024c07b55d4e0e0486bb44` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:13.157208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e77489ac024c07b55d4e0e0486bb44)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:13.159828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:13.350866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e77489ac024c07b55d4e0e0486bb44'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:13.445129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e77489ac024c07b55d4e0e0486bb44'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:13.458791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e77489ac024c07b55d4e0e0486bb44'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:13.459427 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e77489ac024c07b55d4e0e0486bb44'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:13.466187 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e77489ac024c07b55d4e0e0486bb44'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:13.472649 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1277/2559] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:16:13 2022] DELETE /identity/v3/users/71e77489ac024c07b55d4e0e0486bb44 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:13.477338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:13.477822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:13.477948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:13.496715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:13.500374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:13.554943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1283/2560] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:13.564487 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:13.565860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:13.618684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:13.622451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065faed5-0e01-4a90-ae1d-e8d258e90207 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:13.625978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:13.626596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:13.626927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:13.627227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:13.636564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:13.638030 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:13.647765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1278/2561] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:13.898548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:13.900491 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:13.913909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a578c-99a6-470a-b9fb-b589194cc659 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:13.918719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:13.919266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:13.920102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:13.920372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] PATH_INFO: `/v3/projects/ad8b75ab4ce94734a764726a1c13324f` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:13.921674 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8b75ab4ce94734a764726a1c13324f)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:13.923613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:14.051854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8b75ab4ce94734a764726a1c13324f', 'request_id': 'req-a1de7ada-4374-4426-985a-3e3acae77d80'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.128662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8b75ab4ce94734a764726a1c13324f', 'request_id': 'req-a1de7ada-4374-4426-985a-3e3acae77d80'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.135045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8b75ab4ce94734a764726a1c13324f', 'request_id': 'req-a1de7ada-4374-4426-985a-3e3acae77d80'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.146322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] The token cache is being invalidate because project ad8b75ab4ce94734a764726a1c13324f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:16:14.146613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.147256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.148717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1284/2562] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:16:13 2022] DELETE /identity/v3/projects/ad8b75ab4ce94734a764726a1c13324f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:14.152744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:14.162306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cfbe-c713-4546-997d-00a007a410de service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:14.216883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:14.217495 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:14.217766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:14.218028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] PATH_INFO: `/v3/users/64886933c7bb4ddfb68138bf10923863` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:14.219157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64886933c7bb4ddfb68138bf10923863)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:14.221055 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:14.387492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64886933c7bb4ddfb68138bf10923863'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.462812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64886933c7bb4ddfb68138bf10923863'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.476005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64886933c7bb4ddfb68138bf10923863'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.476668 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64886933c7bb4ddfb68138bf10923863'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.483703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-f1dfdc99-2170-4392-a641-7fe7d0800ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64886933c7bb4ddfb68138bf10923863'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:14.490146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1279/2563] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:16:14 2022] DELETE /identity/v3/users/64886933c7bb4ddfb68138bf10923863 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:14.912291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:14.912291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:14.918362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de7ada-4374-4426-985a-3e3acae77d80 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:14.943636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:14.975757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:14.976380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:14.976656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:14.976924 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] PATH_INFO: `/v3/projects/7c959b26191b4a99b60591092f8c5999` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:14.978034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c959b26191b4a99b60591092f8c5999)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:14.979969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:15.079095 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c959b26191b4a99b60591092f8c5999', 'request_id': 'req-b837bba2-a3b0-47fa-a4fd-eb335e018372'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:15.165268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c959b26191b4a99b60591092f8c5999', 'request_id': 'req-b837bba2-a3b0-47fa-a4fd-eb335e018372'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:15.171108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c959b26191b4a99b60591092f8c5999', 'request_id': 'req-b837bba2-a3b0-47fa-a4fd-eb335e018372'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:15.182215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] The token cache is being invalidate because project 7c959b26191b4a99b60591092f8c5999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:16:15.182496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:15.183138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-b837bba2-a3b0-47fa-a4fd-eb335e018372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:16:15.184595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1285/2564] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:16:14 2022] DELETE /identity/v3/projects/7c959b26191b4a99b60591092f8c5999 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:15.190536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb471-eace-487a-b50a-d67d62bb32a9 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.191052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb471-eace-487a-b50a-d67d62bb32a9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.191140 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb471-eace-487a-b50a-d67d62bb32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.211234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-fa4bb471-eace-487a-b50a-d67d62bb32a9 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:15.212400 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fa4bb471-eace-487a-b50a-d67d62bb32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:15.270141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1280/2565] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:15.279118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47c18-d2a8-4bdb-819a-3ca2c2be26ce None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.279400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47c18-d2a8-4bdb-819a-3ca2c2be26ce None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.279671 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f47c18-d2a8-4bdb-819a-3ca2c2be26ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.299235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b2f47c18-d2a8-4bdb-819a-3ca2c2be26ce None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:15.300408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b2f47c18-d2a8-4bdb-819a-3ca2c2be26ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:15.308632 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1286/2566] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:15.312966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb471-eace-487a-b50a-d67d62bb32a9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:15.323358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb471-eace-487a-b50a-d67d62bb32a9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:15.327848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:15.329727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.329727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.329727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.329727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:16:15.330063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:15.331588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:15.338238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:15.343393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1281/2567] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:16:15.347767 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f47c18-d2a8-4bdb-819a-3ca2c2be26ce None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:15.357237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f47c18-d2a8-4bdb-819a-3ca2c2be26ce None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:15.361959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:15.362552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.362866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.363136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.364291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:15.366228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:15.463963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1287/2568] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:16:15 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:16:15.468201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:15.479129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54c34-fa54-4453-a398-6d62bfc6efa3 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:15.533986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:15.534599 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.534890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.535160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.535781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:15.537689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:15.656879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1282/2569] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:16:15 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:16:15.660958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:15.671263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319b524-fe9d-49d6-9658-6e9efbaadabc admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:15.675986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:15.677186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.677465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.677734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.678472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:15.680101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:15.698563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1288/2570] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:16:15.701347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:15.711592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be52d-7dc3-4cf4-bf0d-c8d0ef13d964 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:15.716196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b3df8-ee36-46a9-8c37-1774d668e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:15.716784 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b3df8-ee36-46a9-8c37-1774d668e863 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.717063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b3df8-ee36-46a9-8c37-1774d668e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.717333 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b3df8-ee36-46a9-8c37-1774d668e863 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.717961 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b3df8-ee36-46a9-8c37-1774d668e863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:15.719635 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b3df8-ee36-46a9-8c37-1774d668e863 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:15.730712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1283/2571] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:16:15.734841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:15.745350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b9a3-a6a1-45be-92ad-239b89b63ec7 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:15.749883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:15.750526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.750839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.751108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] PATH_INFO: `/v3/projects/d6cd862b43174291bde82df1efdabba4/users/b8032870b81347afa904c49a0c53ba8e/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.765540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cd862b43174291bde82df1efdabba4, user_id=b8032870b81347afa904c49a0c53ba8e, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:15.768340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:15.836914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1289/2572] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:16:15 2022] PUT /identity/v3/projects/d6cd862b43174291bde82df1efdabba4/users/b8032870b81347afa904c49a0c53ba8e/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:16:15.844893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286121e-4e2d-411e-95bc-fd14170386a1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.845183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286121e-4e2d-411e-95bc-fd14170386a1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.845458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286121e-4e2d-411e-95bc-fd14170386a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:15.865435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-6286121e-4e2d-411e-95bc-fd14170386a1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:15.866606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-6286121e-4e2d-411e-95bc-fd14170386a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:15.924060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1284/2573] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:15.934409 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:15.936053 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:15.992461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2011d-d24c-42fe-9eb9-b4a301ea3f4b admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:15.996118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d9ecb-9744-4cc3-b67a-e1f9f34b1309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:15.996714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9ecb-9744-4cc3-b67a-e1f9f34b1309 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:15.996992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9ecb-9744-4cc3-b67a-e1f9f34b1309 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:15.997261 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9ecb-9744-4cc3-b67a-e1f9f34b1309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:16.004070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:16.006281 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d9ecb-9744-4cc3-b67a-e1f9f34b1309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:16.007754 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d9ecb-9744-4cc3-b67a-e1f9f34b1309 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:16.016987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1290/2574] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:21.326940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.327454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.327556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.358245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] MFA Rules not processed for user `b8032870b81347afa904c49a0c53ba8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:21.359478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.424662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1285/2575] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:16:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:16:21.436193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c667-1033-446a-960f-29aead0f2050 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.436655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c667-1033-446a-960f-29aead0f2050 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.436782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c667-1033-446a-960f-29aead0f2050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.455579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-80f2c667-1033-446a-960f-29aead0f2050 None None] MFA Rules not processed for user `b8032870b81347afa904c49a0c53ba8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:21.456781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-80f2c667-1033-446a-960f-29aead0f2050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.464463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1291/2576] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:16:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:21.478125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:21.479578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:21.489464 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:21.582171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7eb5f-eb06-4988-bb27-6acc5d3def9d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:21.588447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136ce8c-974e-4fac-b550-e41870d7acfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:21.592258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ce8c-974e-4fac-b550-e41870d7acfb service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:21.592258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ce8c-974e-4fac-b550-e41870d7acfb service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:21.592258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ce8c-974e-4fac-b550-e41870d7acfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:21.597473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ce8c-974e-4fac-b550-e41870d7acfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:21.600155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ce8c-974e-4fac-b550-e41870d7acfb service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:21.608962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1286/2577] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:31.449994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=5 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:31.763073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=43 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:34.517417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70d16-e956-4479-9509-f27b9729f53f None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:34.517976 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70d16-e956-4479-9509-f27b9729f53f None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:34.518154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a70d16-e956-4479-9509-f27b9729f53f None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:34.519535 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1292/2578] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 10:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 10:16:34.525157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:34.525588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:34.525694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:34.563122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:16:34.564310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:34.570874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1287/2579] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:16:34.584031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70d16-e956-4479-9509-f27b9729f53f None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:34.594827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a70d16-e956-4479-9509-f27b9729f53f None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:34.598520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:34.599622 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:34.599893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:34.600155 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:34.607108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:34.608509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:34.616554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1293/2580] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:34.802790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:34.804160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:34.873260 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002c190-7b73-41f2-83ac-bc5481108a9d None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:34.878060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:34.878654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:34.878956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:34.879222 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:34.880904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:34.892015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:34.893595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:34.904049 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1288/2581] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:35.258822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:16:35.267595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584c9bb-0dec-48d3-a17a-f6a09fd13b3c service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:16:35.271837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:16:35.272421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:16:35.272702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:16:35.272971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:16:35.274745 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:16:35.287734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:16:35.289187 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:16:35.299802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1294/2582] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:44.899800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=41 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:45.295115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:10.033177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:10.034700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:10.046742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713946ac-e1e7-4959-ad3e-3bce575d1ecc service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:10.050176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:10.050792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:10.051066 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:10.051334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:10.052963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:10.061937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:10.063377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:10.071071 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1289/2583] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:20.067584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:25.850241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:25.861126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b1e6-6580-44ba-b88e-2611da31d102 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:25.865687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:25.866304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:25.866607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:25.867035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] PATH_INFO: `/v3/users/b8032870b81347afa904c49a0c53ba8e` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:25.868151 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8032870b81347afa904c49a0c53ba8e)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:25.870090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.051197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8032870b81347afa904c49a0c53ba8e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.139897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8032870b81347afa904c49a0c53ba8e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.140515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8032870b81347afa904c49a0c53ba8e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.147520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8032870b81347afa904c49a0c53ba8e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.159237 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6d6771e6-348b-4f5c-8514-2240cdd1f2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8032870b81347afa904c49a0c53ba8e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.165249 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1295/2584] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:17:25 2022] DELETE /identity/v3/users/b8032870b81347afa904c49a0c53ba8e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:26.408092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:26.421212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6124f7-fc20-4300-85f4-ff8809f7ca2f service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:26.479332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:26.479963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.480836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.481073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] PATH_INFO: `/v3/projects/d6cd862b43174291bde82df1efdabba4` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.482226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cd862b43174291bde82df1efdabba4)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:26.484161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.579790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cd862b43174291bde82df1efdabba4', 'request_id': 'req-89185047-5cc2-45a7-8bf5-0b44309f571c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.640074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cd862b43174291bde82df1efdabba4', 'request_id': 'req-89185047-5cc2-45a7-8bf5-0b44309f571c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.645556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cd862b43174291bde82df1efdabba4', 'request_id': 'req-89185047-5cc2-45a7-8bf5-0b44309f571c'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.657103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] The token cache is being invalidate because project d6cd862b43174291bde82df1efdabba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:17:26.657324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.657941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-89185047-5cc2-45a7-8bf5-0b44309f571c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:17:26.659424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1290/2585] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:17:26 2022] DELETE /identity/v3/projects/d6cd862b43174291bde82df1efdabba4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:26.664630 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17675-6879-4473-a476-d644cb0eafdd None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.664922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17675-6879-4473-a476-d644cb0eafdd None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.665254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17675-6879-4473-a476-d644cb0eafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.686710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-56b17675-6879-4473-a476-d644cb0eafdd None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:26.687915 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-56b17675-6879-4473-a476-d644cb0eafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:26.746537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1296/2586] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:26.755150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc5441-8b07-4356-8d7d-751de3921cf1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.755433 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc5441-8b07-4356-8d7d-751de3921cf1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.758565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc5441-8b07-4356-8d7d-751de3921cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.776025 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b4fc5441-8b07-4356-8d7d-751de3921cf1 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:26.777935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b4fc5441-8b07-4356-8d7d-751de3921cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:26.789660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1291/2587] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:26.790904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b17675-6879-4473-a476-d644cb0eafdd None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:26.800689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b17675-6879-4473-a476-d644cb0eafdd None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:26.805294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:26.805883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.806160 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.806427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.807088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:17:26.807576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:26.809054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.820841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1297/2588] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:17:26.825810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc5441-8b07-4356-8d7d-751de3921cf1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:26.835619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc5441-8b07-4356-8d7d-751de3921cf1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:26.840924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:26.841524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:26.841797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:26.842063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:26.842734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:26.844648 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:26.957343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1292/2589] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:26.961490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:26.972410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84add6b0-20eb-4fa4-acab-78ba493e66b3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.026738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.027932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.028202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.028468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.029097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.031061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.038921 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:27.131654 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1298/2590] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:17:26 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:17:27.135947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.146208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a45e9-ee79-4581-bb58-894d3fdb4013 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.150878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.151477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.151739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.152533 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.153158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.154930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.164617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1293/2591] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:27.169080 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.179238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4f1ce-9b49-4b51-8cf1-85e3aaa0f083 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.183785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73297444-f54a-426b-8a97-d87ac6e72e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.184366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297444-f54a-426b-8a97-d87ac6e72e03 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.184637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297444-f54a-426b-8a97-d87ac6e72e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.184901 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73297444-f54a-426b-8a97-d87ac6e72e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.185526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73297444-f54a-426b-8a97-d87ac6e72e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.187127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73297444-f54a-426b-8a97-d87ac6e72e03 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.197515 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1299/2592] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:17:27.201673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.211556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c186f-8ae5-4ecc-89b9-813f71d825f2 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.216576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.217204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.217478 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.217745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] PATH_INFO: `/v3/projects/655c7b496bf14c6f99c9423211be39a6/users/ef3aff2deb6a4353b35616e948ddfe6f/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.233848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655c7b496bf14c6f99c9423211be39a6, user_id=ef3aff2deb6a4353b35616e948ddfe6f, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.236542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.303122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1294/2593] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:17:27 2022] PUT /identity/v3/projects/655c7b496bf14c6f99c9423211be39a6/users/ef3aff2deb6a4353b35616e948ddfe6f/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:17:27.308206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50a33-6cee-4bad-b7db-00af401320c4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.313028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50a33-6cee-4bad-b7db-00af401320c4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.313028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e50a33-6cee-4bad-b7db-00af401320c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.327598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-31e50a33-6cee-4bad-b7db-00af401320c4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:27.328810 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-31e50a33-6cee-4bad-b7db-00af401320c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:27.385801 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1300/2594] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:17:27.395401 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:27.397067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:27.428206 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:27.454192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a6910-63ff-4784-8b8b-378ac0b752d3 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:27.457822 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cddef-9f4c-49d5-b4ad-c4199db0fe88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:27.458413 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cddef-9f4c-49d5-b4ad-c4199db0fe88 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:27.458719 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cddef-9f4c-49d5-b4ad-c4199db0fe88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:27.458991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cddef-9f4c-49d5-b4ad-c4199db0fe88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:27.468498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cddef-9f4c-49d5-b4ad-c4199db0fe88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:27.470376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cddef-9f4c-49d5-b4ad-c4199db0fe88 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:27.480267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1295/2595] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:32.663691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:32.664137 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:32.664313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:32.715636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] MFA Rules not processed for user `ef3aff2deb6a4353b35616e948ddfe6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:32.716987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:32.786878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1301/2596] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:17:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:32.799269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd6651-c944-4880-a589-496e9e141e58 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:32.799725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd6651-c944-4880-a589-496e9e141e58 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:32.799860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd6651-c944-4880-a589-496e9e141e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:32.821199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-8acd6651-c944-4880-a589-496e9e141e58 None None] MFA Rules not processed for user `ef3aff2deb6a4353b35616e948ddfe6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:17:32.831251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8acd6651-c944-4880-a589-496e9e141e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:32.845024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1296/2597] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:17:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:17:32.859851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:32.861863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:32.952243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1054a-cefd-476b-93a1-4b6fc45823a2 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:32.959006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:32.959595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:32.964110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:32.964110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:32.965126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:32.969365 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:32.971275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:32.983848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1302/2598] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:33.684497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd6651-c944-4880-a589-496e9e141e58 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:33.695498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd6651-c944-4880-a589-496e9e141e58 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:33.700907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:33.701518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:33.701790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:33.702103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:33.703913 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:33.720112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:33.721953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:33.737184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1297/2599] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:34.870154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:34.884702 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e352-d260-4e0a-b9ea-56878bb3d030 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:34.885981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:34.887291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:34.887564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:34.887986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:34.890045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:34.908803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:34.912061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:34.925691 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1303/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:17:37.841928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:17:37.843578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:37.858706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402018e3-40ca-4faf-809f-29a8e6809b97 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:17:37.865064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7f8bc-484d-4fa2-b377-6f8f077c8ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:17:37.865632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f8bc-484d-4fa2-b377-6f8f077c8ee7 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:17:37.865906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f8bc-484d-4fa2-b377-6f8f077c8ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:17:37.866237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7f8bc-484d-4fa2-b377-6f8f077c8ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:17:37.867993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cfc7f8bc-484d-4fa2-b377-6f8f077c8ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:17:37.880376 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7f8bc-484d-4fa2-b377-6f8f077c8ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:17:37.881969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7f8bc-484d-4fa2-b377-6f8f077c8ee7 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:17:37.893170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1298/2601] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:17:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:17:44.920400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=9 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:47.888314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=29 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:26.192943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:26.204485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151b82d-acc6-4f03-afd3-e94f8fd1cc55 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:26.210069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:26.210744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:26.210966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:26.211267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:26.212954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:26.226068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:26.227655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:26.237791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1304/2602] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:33.695783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:33.696243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:33.696426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:33.716676 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] MFA Rules not processed for user `ef3aff2deb6a4353b35616e948ddfe6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:18:33.718432 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:33.725566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1299/2603] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:18:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:18:33.984130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:33.993303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6915a09-687f-466c-9fee-0f877d49ccc6 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:33.996885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:33.999656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:33.999656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:33.999656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:33.999918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:34.009014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:34.010417 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:34.018967 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1305/2604] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:34.431942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:18:34.433613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:34.508051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc46a0-c417-43f8-a5ca-e12bc1ee5ca9 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:18:34.513014 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:18:34.513614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:18:34.513920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:18:34.514192 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:18:34.515936 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:18:34.527167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:18:34.528954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:18:34.539373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1300/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:18:44.015342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:44.535007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=35 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:20.855531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:20.867997 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78012b-d76e-448f-9e71-3f5e4dfcd431 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:20.872959 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:20.873552 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:20.873825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:20.874089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:20.875797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:20.887659 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:20.889213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:20.899003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1306/2606] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:30.894773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:40.314404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.317569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:40.328642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea5add-d501-4e34-be27-22368e3f618e service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.334116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.334743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.335024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.335296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.336951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:40.349265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.350868 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.361323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1301/2607] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:40.457600 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.468344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58f3a-1881-4c20-bef3-01870f6ee63f service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:40.473448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:40.474067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:40.474340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:40.474608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] PATH_INFO: `/v3/users/ef3aff2deb6a4353b35616e948ddfe6f` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:40.475734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3aff2deb6a4353b35616e948ddfe6f)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:40.477639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:40.643108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3aff2deb6a4353b35616e948ddfe6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:40.709907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3aff2deb6a4353b35616e948ddfe6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:40.710548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3aff2deb6a4353b35616e948ddfe6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:40.718521 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3aff2deb6a4353b35616e948ddfe6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:40.731243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-04551b68-7f32-4f3a-bc69-03530daf05c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3aff2deb6a4353b35616e948ddfe6f'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:40.738054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1307/2608] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:19:40 2022] DELETE /identity/v3/users/ef3aff2deb6a4353b35616e948ddfe6f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:40.975816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:40.988317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730fd05-d98c-4809-9c0b-630fbde4aa9d service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.046300 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.046968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.047241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.047509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] PATH_INFO: `/v3/projects/655c7b496bf14c6f99c9423211be39a6` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.048625 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655c7b496bf14c6f99c9423211be39a6)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.050583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.199020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655c7b496bf14c6f99c9423211be39a6', 'request_id': 'req-115df64f-f32c-4081-8f78-d96ea774c530'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.262518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655c7b496bf14c6f99c9423211be39a6', 'request_id': 'req-115df64f-f32c-4081-8f78-d96ea774c530'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.269517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655c7b496bf14c6f99c9423211be39a6', 'request_id': 'req-115df64f-f32c-4081-8f78-d96ea774c530'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.280769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] The token cache is being invalidate because project 655c7b496bf14c6f99c9423211be39a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:19:41.281051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.281717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-115df64f-f32c-4081-8f78-d96ea774c530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:19:41.283223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1302/2609] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:19:40 2022] DELETE /identity/v3/projects/655c7b496bf14c6f99c9423211be39a6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:41.289287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37680ad9-2e46-40f3-a457-e7de6e997892 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.289572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37680ad9-2e46-40f3-a457-e7de6e997892 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.289871 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37680ad9-2e46-40f3-a457-e7de6e997892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.309267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-37680ad9-2e46-40f3-a457-e7de6e997892 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:41.310539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-37680ad9-2e46-40f3-a457-e7de6e997892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:41.368836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1308/2610] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:41.376833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466cd34-76eb-470f-9d89-0a95d5811d20 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.377321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466cd34-76eb-470f-9d89-0a95d5811d20 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.377422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466cd34-76eb-470f-9d89-0a95d5811d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.397742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0466cd34-76eb-470f-9d89-0a95d5811d20 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:41.398966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0466cd34-76eb-470f-9d89-0a95d5811d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:41.406682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1303/2611] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:41.410993 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37680ad9-2e46-40f3-a457-e7de6e997892 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.420586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37680ad9-2e46-40f3-a457-e7de6e997892 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.425228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.425816 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.426090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.426357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.427037 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:19:41.427361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.428933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.440804 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1309/2612] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:19:41.444850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466cd34-76eb-470f-9d89-0a95d5811d20 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.453967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466cd34-76eb-470f-9d89-0a95d5811d20 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.459283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.459859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.460132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.460397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.461021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.463003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.578160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1304/2613] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:19:41 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:19:41.582954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.593150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ffc5-1b72-4214-8bd7-65bf33fb7cf5 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.650089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.650753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.650980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.651245 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.651873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.653825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.661952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:41.782275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1310/2614] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:19:41 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:19:41.787326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.797659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd20dd-b497-4543-a65a-dae4706549dd admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.802207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.802830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.803104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.803368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.803991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.805573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.815582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1305/2615] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:41.824692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.835055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974aca-dd1b-4706-a88f-9d4ed643fe8f admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.839714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baf443-f4a6-4056-816f-793d90bb0d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.840318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf443-f4a6-4056-816f-793d90bb0d71 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.840850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf443-f4a6-4056-816f-793d90bb0d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.841556 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baf443-f4a6-4056-816f-793d90bb0d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.842457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baf443-f4a6-4056-816f-793d90bb0d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.844061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baf443-f4a6-4056-816f-793d90bb0d71 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:41.855371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1311/2616] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:19:41.864608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:41.874345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41646c28-820e-419f-8a30-9340f960baf6 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:41.878907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:41.879536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:41.879807 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:41.880072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] PATH_INFO: `/v3/projects/13692d082ccc471090ed5336deccef99/users/3e44d1be60054c37833fcbf9b13a67a6/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:41.894651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13692d082ccc471090ed5336deccef99, user_id=3e44d1be60054c37833fcbf9b13a67a6, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:41.897444 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:42.001204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1306/2617] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:19:41 2022] PUT /identity/v3/projects/13692d082ccc471090ed5336deccef99/users/3e44d1be60054c37833fcbf9b13a67a6/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:19:42.006458 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a887f-15ef-4d01-bf0d-620dc6cf26a4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:42.006768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a887f-15ef-4d01-bf0d-620dc6cf26a4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:42.007042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a887f-15ef-4d01-bf0d-620dc6cf26a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:42.025913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6b8a887f-15ef-4d01-bf0d-620dc6cf26a4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:42.027154 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6b8a887f-15ef-4d01-bf0d-620dc6cf26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:42.084299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1312/2618] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:42.094234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:42.095902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:42.110770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:42.153076 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ecde7-2a88-45f5-bfa3-825fe68e1230 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:42.156789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:42.157379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:42.157654 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:42.157929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:42.166978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:42.168407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:42.177592 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1307/2619] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:47.566337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6737ff-c777-496d-ab30-678f31205c55 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:47.566910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6737ff-c777-496d-ab30-678f31205c55 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:47.567244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6737ff-c777-496d-ab30-678f31205c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:47.598278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1a6737ff-c777-496d-ab30-678f31205c55 None None] MFA Rules not processed for user `3e44d1be60054c37833fcbf9b13a67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:47.599525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1a6737ff-c777-496d-ab30-678f31205c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.673563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1313/2620] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:19:47.693426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:19:47.694953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:47.773564 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae45fcb-4319-48fa-99cd-6689596322fa service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:19:47.779224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22681d1-2aee-4b8a-9c5a-37808c71af1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:19:47.779909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22681d1-2aee-4b8a-9c5a-37808c71af1f service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:47.780188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22681d1-2aee-4b8a-9c5a-37808c71af1f service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:47.780452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22681d1-2aee-4b8a-9c5a-37808c71af1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:47.789540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22681d1-2aee-4b8a-9c5a-37808c71af1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:19:47.791213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22681d1-2aee-4b8a-9c5a-37808c71af1f service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:19:47.800848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1308/2621] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:19:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:19:49.969186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae539-bf6a-4662-bd51-cb067fc91ecb None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:19:49.969640 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae539-bf6a-4662-bd51-cb067fc91ecb None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:19:49.970382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae539-bf6a-4662-bd51-cb067fc91ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:19:49.989902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-94eae539-bf6a-4662-bd51-cb067fc91ecb None None] MFA Rules not processed for user `3e44d1be60054c37833fcbf9b13a67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:19:49.991152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-94eae539-bf6a-4662-bd51-cb067fc91ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:19:50.001589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1314/2622] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:19:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:19:57.796261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=54 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:59.983751 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:09.532210 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:09.532717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:09.532841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:09.552132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] MFA Rules not processed for user `3e44d1be60054c37833fcbf9b13a67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:21:09.553809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:09.560687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1309/2623] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:21:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:21:09.861701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eae539-bf6a-4662-bd51-cb067fc91ecb None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:09.871998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eae539-bf6a-4662-bd51-cb067fc91ecb None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:09.875548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:09.876140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:09.876415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:09.876682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:09.878381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:09.888033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:09.889443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:09.897553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1315/2624] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:19.546894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:19.893719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:23.332630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:21:23.334205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:23.352104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63273053-2b5d-42cf-bfd4-a096cf0b2dd6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:21:23.358077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:21:23.358734 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:21:23.362559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:21:23.362559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:21:23.362559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:21:23.374445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:21:23.376109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:21:23.386979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1310/2625] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:21:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:21:33.382241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:07.728968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:07.763785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b0687-3b07-4271-881f-52b8fb9474bb service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:07.767380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:07.767980 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:07.768256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:07.768525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:07.770231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:07.800850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:07.802252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:07.810573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1316/2626] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:07.955486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:07.956916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:08.061969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b5506-7110-4e53-936f-d35d826fb9c5 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:08.066957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:08.067551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:08.067829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:08.068100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:08.069938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:08.081321 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:08.083207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:08.093199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1311/2627] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:08.387121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:08.395764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0660f2-1230-4c72-94a0-35d29afe87c0 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:08.399374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6ac7e-f861-4092-ab64-762565d93e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:08.399962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ac7e-f861-4092-ab64-762565d93e1e service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:08.400235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ac7e-f861-4092-ab64-762565d93e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:08.400503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6ac7e-f861-4092-ab64-762565d93e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:08.402692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e6f6ac7e-f861-4092-ab64-762565d93e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:08.415442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6ac7e-f861-4092-ab64-762565d93e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:08.417466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6ac7e-f861-4092-ab64-762565d93e1e service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:08.428026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1317/2628] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:10.226289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:10.227636 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:10.242088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036d36-28f1-4f54-8e89-bde7a9eb1619 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:10.245572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:10.246151 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:10.246424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:10.246703 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:10.248324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:10.257305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:10.258744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:10.266468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1312/2629] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:18.423376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=31 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:20.263144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=57 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:28.977567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66bc5c-dc61-44af-a7e3-488724be5062 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:28.978055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66bc5c-dc61-44af-a7e3-488724be5062 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:28.978198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66bc5c-dc61-44af-a7e3-488724be5062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:28.997332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3a66bc5c-dc61-44af-a7e3-488724be5062 None None] MFA Rules not processed for user `3e44d1be60054c37833fcbf9b13a67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:22:28.998543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3a66bc5c-dc61-44af-a7e3-488724be5062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:29.005322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1318/2630] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:22:35.371146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:35.379766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585cc0d-25d6-408f-bb70-ef3b384bde5a service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:35.383396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:35.383979 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:35.384257 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:35.384527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:35.386870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:35.408682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:35.410108 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:35.420962 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1313/2631] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:22:36.597489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66bc5c-dc61-44af-a7e3-488724be5062 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:22:36.607597 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66bc5c-dc61-44af-a7e3-488724be5062 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:22:36.611173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:22:36.611764 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:22:36.612043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:22:36.612316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:22:36.614027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:22:36.627665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:22:36.629078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:22:36.639826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1319/2632] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:22:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:22:45.416026 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=9 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:46.635012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=9 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:43.743953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:43.765725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ae1df-fc57-4a56-b4fb-12d7595cb62b service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:43.767345 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f22345-0927-42df-b8a5-9bea4f2185bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:43.768438 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f22345-0927-42df-b8a5-9bea4f2185bb service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:43.768920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f22345-0927-42df-b8a5-9bea4f2185bb service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:43.769509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f22345-0927-42df-b8a5-9bea4f2185bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:43.771296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f0f22345-0927-42df-b8a5-9bea4f2185bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:43.795147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f22345-0927-42df-b8a5-9bea4f2185bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:43.795147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f22345-0927-42df-b8a5-9bea4f2185bb service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:43.800414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1314/2633] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:53.794031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:55.054642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:55.066785 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84bda1-860e-47c4-9fe5-4035c6d9ebcc service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:55.072776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:55.073536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:55.073812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:55.074082 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:55.075852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:55.088692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:55.090250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:55.113419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1320/2634] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:56.297838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:56.298283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:56.298382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:56.318154 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] MFA Rules not processed for user `3e44d1be60054c37833fcbf9b13a67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:23:56.319365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:56.326052 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1315/2635] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:23:56.629738 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:56.639056 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e51a3-63ed-4489-bac4-33619ad3456e service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:56.643079 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:56.643802 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:56.644076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:56.644341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:56.646030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:56.655183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:56.657107 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:56.665134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1321/2636] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:23:57.087810 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:23:57.089349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:57.104711 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe969f1-bb84-4f99-926c-f0a9d9ddeb93 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:23:57.109637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:23:57.110231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:23:57.110500 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:23:57.110799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:23:57.112460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:23:57.124586 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:23:57.126207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:23:57.136118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1316/2637] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:23:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:06.661444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:07.131879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=9 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:27.772041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:27.793364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69066fe8-69dc-4d21-b456-ff451ccfb213 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:27.798286 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:27.799546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:27.799814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:27.800078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:27.801772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:27.824794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:27.826383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:27.836431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1322/2638] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:37.832246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=15 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:47.976653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:24:47.978054 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:24:48.053697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d0ab3-6213-4455-bbd7-3d481d95c603 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:24:48.057272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b18f309b5cb4641997b637f8f17ac87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:24:48.057861 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:24:48.058132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:24:48.058394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:24:48.066927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:24:48.068334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:24:48.076819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1317/2639] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:24:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:24:58.072939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=35 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:16.094776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:16.103868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e47605-6f9b-47f9-8858-7b0a39cbe717 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:16.107420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:16.107999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:16.108272 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:16.108539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:16.117635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:16.119073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:16.146200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1323/2640] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:19.689838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:19.701115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983dac-81b4-41d0-b0af-45d972c6687b service cinder] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:19.706930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:19.707523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:19.709559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:19.709559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:19.709742 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:19.721927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:19.723583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:19.733681 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1318/2641] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:26:19.805054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:19.821864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ccf60-3c7d-4dfc-8978-e2cc3776df54 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:19.821864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:19.821864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:19.821864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:19.822621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] PATH_INFO: `/v3/users/3e44d1be60054c37833fcbf9b13a67a6` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:19.822770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e44d1be60054c37833fcbf9b13a67a6)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:19.824678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:19.954986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e44d1be60054c37833fcbf9b13a67a6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.003934 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e44d1be60054c37833fcbf9b13a67a6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.004582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e44d1be60054c37833fcbf9b13a67a6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.011883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e44d1be60054c37833fcbf9b13a67a6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.024396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-658e32c3-0f2a-4617-8e3d-725fa80774e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e44d1be60054c37833fcbf9b13a67a6'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.030436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1324/2642] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:26:19 2022] DELETE /identity/v3/users/3e44d1be60054c37833fcbf9b13a67a6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:20.255180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:20.266097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bbc21-81f6-4206-b652-71f78f4c6587 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:20.322932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:20.323554 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:20.329605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:20.329605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] PATH_INFO: `/v3/projects/13692d082ccc471090ed5336deccef99` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:20.329605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13692d082ccc471090ed5336deccef99)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:20.329605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:20.426777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13692d082ccc471090ed5336deccef99', 'request_id': 'req-d0eddb85-9264-460c-af41-99f6a24b9e34'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.495002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13692d082ccc471090ed5336deccef99', 'request_id': 'req-d0eddb85-9264-460c-af41-99f6a24b9e34'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.501213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13692d082ccc471090ed5336deccef99', 'request_id': 'req-d0eddb85-9264-460c-af41-99f6a24b9e34'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.523779 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] The token cache is being invalidate because project 13692d082ccc471090ed5336deccef99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:26:20.524063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.524691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-d0eddb85-9264-460c-af41-99f6a24b9e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:26:20.526208 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1319/2643] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:26:20 2022] DELETE /identity/v3/projects/13692d082ccc471090ed5336deccef99 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:26:20.531275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8a0ff-0230-4714-9885-22904a6d2106 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:20.531555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8a0ff-0230-4714-9885-22904a6d2106 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:20.531820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8a0ff-0230-4714-9885-22904a6d2106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:20.588879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0ca8a0ff-0230-4714-9885-22904a6d2106 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:20.590064 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0ca8a0ff-0230-4714-9885-22904a6d2106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:20.647018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1325/2644] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:20.654864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510a9e-81ca-40e2-84ba-2837f829c561 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:20.655147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510a9e-81ca-40e2-84ba-2837f829c561 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:20.655417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51510a9e-81ca-40e2-84ba-2837f829c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:20.674924 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-51510a9e-81ca-40e2-84ba-2837f829c561 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:20.676096 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-51510a9e-81ca-40e2-84ba-2837f829c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:20.686027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1320/2645] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:20.690873 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8a0ff-0230-4714-9885-22904a6d2106 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:20.700513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8a0ff-0230-4714-9885-22904a6d2106 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:20.705222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:20.705806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:20.706078 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:20.706343 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:20.707034 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:26:20.707328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:20.708900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:20.717352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:20.720994 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1326/2646] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:26:20.730710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51510a9e-81ca-40e2-84ba-2837f829c561 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:20.740769 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51510a9e-81ca-40e2-84ba-2837f829c561 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:20.745454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:20.746040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:20.746340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:20.746603 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:20.747271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:20.749153 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:20.845699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1321/2647] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:26:20 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:20.849825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:20.860577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b90b-8e09-4999-8d2e-8a43012d336f admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:20.914382 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:20.915027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:20.915309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:20.915564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:20.916173 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:20.918104 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:20.987665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1327/2648] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:26:20 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:26:20.992155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:21.002830 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cbfd2-b2b1-443a-9919-1c1351f68164 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:21.007344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:21.007930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:21.008271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:21.008545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:21.009215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:21.010843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:21.020638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1322/2649] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:21.024834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:21.035360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497efee-af9e-4e33-9236-bd50bf7b7cd8 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:21.040362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeef87-e7e3-48a6-bddd-16f1f6914790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:21.040947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeef87-e7e3-48a6-bddd-16f1f6914790 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:21.041221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeef87-e7e3-48a6-bddd-16f1f6914790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:21.041488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeef87-e7e3-48a6-bddd-16f1f6914790 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:21.042122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeef87-e7e3-48a6-bddd-16f1f6914790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:21.043820 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeef87-e7e3-48a6-bddd-16f1f6914790 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:21.055264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1328/2650] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:26:21.059453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:21.070212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741e640-31ff-405a-9231-e0ed5362e825 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:21.074965 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:21.075614 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:21.075893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:21.076167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] PATH_INFO: `/v3/projects/28780035ef9c4d36b6e4e3be7f2ca080/users/546dc3e82afb4995abef5670f0352340/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:21.092133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28780035ef9c4d36b6e4e3be7f2ca080, user_id=546dc3e82afb4995abef5670f0352340, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:21.095708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:21.101365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:21.193445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1323/2651] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:26:21 2022] PUT /identity/v3/projects/28780035ef9c4d36b6e4e3be7f2ca080/users/546dc3e82afb4995abef5670f0352340/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:26:21.198715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce27d32-fdd6-46a9-85c7-1928eb40f526 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:21.199299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce27d32-fdd6-46a9-85c7-1928eb40f526 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:21.199595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce27d32-fdd6-46a9-85c7-1928eb40f526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:21.219912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7ce27d32-fdd6-46a9-85c7-1928eb40f526 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:21.221091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7ce27d32-fdd6-46a9-85c7-1928eb40f526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:21.278424 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1329/2652] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:21.288622 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:21.290259 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:21.345507 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26718c-98b4-4fb2-8784-15d94dc83281 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:21.349143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af8758-5ad1-4123-9a4f-bfe2127a833b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:21.349731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af8758-5ad1-4123-9a4f-bfe2127a833b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:21.350002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af8758-5ad1-4123-9a4f-bfe2127a833b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:21.350267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af8758-5ad1-4123-9a4f-bfe2127a833b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:21.359019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af8758-5ad1-4123-9a4f-bfe2127a833b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:21.360469 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af8758-5ad1-4123-9a4f-bfe2127a833b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:21.370024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1324/2653] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:26.405130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:26.405647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:26.405831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:26.444250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] MFA Rules not processed for user `546dc3e82afb4995abef5670f0352340`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:26.445681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:26.526588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1330/2654] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:26.537080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622fcfd-8b15-407f-8e95-e0848aaaa9ff None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:26.537639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622fcfd-8b15-407f-8e95-e0848aaaa9ff None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:26.537639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622fcfd-8b15-407f-8e95-e0848aaaa9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:26.557604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-5622fcfd-8b15-407f-8e95-e0848aaaa9ff None None] MFA Rules not processed for user `546dc3e82afb4995abef5670f0352340`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:26.558862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5622fcfd-8b15-407f-8e95-e0848aaaa9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:26.566720 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1325/2655] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:26.579645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:26.581287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:26.595113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:26.690870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185e53f-71e3-4bc7-a773-e03f035ed958 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:26.697040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae883-3802-4d86-a6e7-342179628328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:26.697750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae883-3802-4d86-a6e7-342179628328 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:26.698028 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae883-3802-4d86-a6e7-342179628328 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:26.698472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae883-3802-4d86-a6e7-342179628328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:26.708889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae883-3802-4d86-a6e7-342179628328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:26.710774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae883-3802-4d86-a6e7-342179628328 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:26.720447 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1331/2656] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:26.990935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622fcfd-8b15-407f-8e95-e0848aaaa9ff None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:26:27.001375 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622fcfd-8b15-407f-8e95-e0848aaaa9ff None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:26:27.005021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:26:27.005503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:27.005775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:27.006044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:27.007852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:27.018428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:26:27.019904 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:26:27.028627 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1326/2657] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:26:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:26:36.716017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=42 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:37.025549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:INSERT=1,keystone:SELECT=37 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:41.327010 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080b35-cebf-439b-909d-73313f110104 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:26:41.327964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080b35-cebf-439b-909d-73313f110104 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:26:41.327964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080b35-cebf-439b-909d-73313f110104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:26:41.346648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c4080b35-cebf-439b-909d-73313f110104 None None] MFA Rules not processed for user `546dc3e82afb4995abef5670f0352340`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:26:41.347861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c4080b35-cebf-439b-909d-73313f110104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:26:41.354917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1332/2658] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:26:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:26:51.341569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:08.391255 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:08.403414 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052eb4e-9b67-47ea-9b2e-ef0b77e8cc1a service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:08.408819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:08.412408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:08.412408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:08.412408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] PATH_INFO: `/v3/users/546dc3e82afb4995abef5670f0352340` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:08.412408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546dc3e82afb4995abef5670f0352340)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:08.413072 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:08.632860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546dc3e82afb4995abef5670f0352340'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.711551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546dc3e82afb4995abef5670f0352340'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.724798 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546dc3e82afb4995abef5670f0352340'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.728580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546dc3e82afb4995abef5670f0352340'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.732407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-84913aaf-d0d1-440f-a9a4-9dc33f943a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546dc3e82afb4995abef5670f0352340'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:08.739035 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1327/2659] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:08 2022] DELETE /identity/v3/users/546dc3e82afb4995abef5670f0352340 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:08.984605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4080b35-cebf-439b-909d-73313f110104 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:08.992549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4080b35-cebf-439b-909d-73313f110104 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.050939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.051567 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.051841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.052106 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] PATH_INFO: `/v3/projects/28780035ef9c4d36b6e4e3be7f2ca080` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.053225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28780035ef9c4d36b6e4e3be7f2ca080)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.055256 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.153011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28780035ef9c4d36b6e4e3be7f2ca080', 'request_id': 'req-a508ce01-17fb-46d5-9433-30d63df6125d'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.208376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28780035ef9c4d36b6e4e3be7f2ca080', 'request_id': 'req-a508ce01-17fb-46d5-9433-30d63df6125d'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.214377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28780035ef9c4d36b6e4e3be7f2ca080', 'request_id': 'req-a508ce01-17fb-46d5-9433-30d63df6125d'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.226439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] The token cache is being invalidate because project 28780035ef9c4d36b6e4e3be7f2ca080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:09.226663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.227323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-a508ce01-17fb-46d5-9433-30d63df6125d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:09.228779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1333/2660] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:08 2022] DELETE /identity/v3/projects/28780035ef9c4d36b6e4e3be7f2ca080 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:09.233805 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f612-23d8-48ae-857f-2c70297c6be8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.234094 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f612-23d8-48ae-857f-2c70297c6be8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.234368 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01f612-23d8-48ae-857f-2c70297c6be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.253549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1d01f612-23d8-48ae-857f-2c70297c6be8 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:09.254766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1d01f612-23d8-48ae-857f-2c70297c6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:09.313136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1328/2661] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:09.321243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ced2-17d0-4d03-bb3a-c8acf1f46b33 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.321524 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ced2-17d0-4d03-bb3a-c8acf1f46b33 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.321793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ced2-17d0-4d03-bb3a-c8acf1f46b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.341988 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9438ced2-17d0-4d03-bb3a-c8acf1f46b33 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:09.343205 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9438ced2-17d0-4d03-bb3a-c8acf1f46b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:09.351436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1334/2662] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:09.355596 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01f612-23d8-48ae-857f-2c70297c6be8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.365218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01f612-23d8-48ae-857f-2c70297c6be8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.369767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.370360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.370639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.370944 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.371630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:09.371929 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.373521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.385457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1329/2663] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:09.389605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438ced2-17d0-4d03-bb3a-c8acf1f46b33 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.399594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438ced2-17d0-4d03-bb3a-c8acf1f46b33 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.404263 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.404848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.405120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.405387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.406008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.407920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.478303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1335/2664] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:09 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:09.482606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.492590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa38e9-536f-4fa2-abfe-5a40c836cf66 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.548543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.549122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.549397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.549660 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.550281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.552219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.559973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:09.631516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1330/2665] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:09 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:09.635714 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.646551 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e437-56c9-4d23-8c49-69b869781367 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.651099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.651683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.651955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.652217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.652845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.654408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.664651 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1336/2666] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:27:09.668488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.678601 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5ea2-3758-4aa0-9a8d-fcc881491a41 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.686000 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7af952-8992-4946-bc3f-d0f0bbd67d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.686618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af952-8992-4946-bc3f-d0f0bbd67d50 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.686967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af952-8992-4946-bc3f-d0f0bbd67d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.687236 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af952-8992-4946-bc3f-d0f0bbd67d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.687873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7af952-8992-4946-bc3f-d0f0bbd67d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.690003 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7af952-8992-4946-bc3f-d0f0bbd67d50 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.701954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1331/2667] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:09.706869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.716751 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da31da7-66c0-4e23-85c9-a3c8239e07a2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.721496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:09.722141 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.722422 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.722742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] PATH_INFO: `/v3/projects/c609695330394b9e80b9507af7b984b1/users/09cd101c487b4e21baa9b1b20ebeb0ed/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.737572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c609695330394b9e80b9507af7b984b1, user_id=09cd101c487b4e21baa9b1b20ebeb0ed, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:09.740211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:09.825528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1337/2668] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:09 2022] PUT /identity/v3/projects/c609695330394b9e80b9507af7b984b1/users/09cd101c487b4e21baa9b1b20ebeb0ed/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:09.835963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:09.836246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:09.836517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:09.864484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] MFA Rules not processed for user `09cd101c487b4e21baa9b1b20ebeb0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:09.865691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:09.927839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1332/2669] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:09.937944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:09.940267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:09.970108 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:09.995481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598f5d3-0d7f-465b-bfdb-f5ac4f1bcd4b admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:09.999644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:10.000234 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:10.000504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:10.000769 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:10.009608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:10.011059 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:10.019586 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1338/2670] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:19.925109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:20.042302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=14 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:24.722585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:24.724044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:24.795499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d745f9-b9c0-4bdc-bdb5-dcd523840ee8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:24.800617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07364-f796-4cde-9e3e-a0b888a4d0bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:24.801212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07364-f796-4cde-9e3e-a0b888a4d0bd service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:24.801483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07364-f796-4cde-9e3e-a0b888a4d0bd service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:24.801741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07364-f796-4cde-9e3e-a0b888a4d0bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:24.803472 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-63c07364-f796-4cde-9e3e-a0b888a4d0bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:24.815139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07364-f796-4cde-9e3e-a0b888a4d0bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:24.816789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07364-f796-4cde-9e3e-a0b888a4d0bd service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:24.826759 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1333/2671] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:25.993589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.057768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5aeda-b36e-4f68-86b4-447e6dfebcd0 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.062268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.062917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.063198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.063471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] PATH_INFO: `/v3/users/09cd101c487b4e21baa9b1b20ebeb0ed` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.064618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cd101c487b4e21baa9b1b20ebeb0ed)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.066534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.250359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cd101c487b4e21baa9b1b20ebeb0ed'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.322039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cd101c487b4e21baa9b1b20ebeb0ed'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.322645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cd101c487b4e21baa9b1b20ebeb0ed'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.330763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cd101c487b4e21baa9b1b20ebeb0ed'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.342973 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cd101c487b4e21baa9b1b20ebeb0ed'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.349473 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1339/2672] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:25 2022] DELETE /identity/v3/users/09cd101c487b4e21baa9b1b20ebeb0ed => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:26.353935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197babb-429d-447d-9629-0973b44615e7 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.354399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197babb-429d-447d-9629-0973b44615e7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.354492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197babb-429d-447d-9629-0973b44615e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.373065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-2197babb-429d-447d-9629-0973b44615e7 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:26.374229 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2197babb-429d-447d-9629-0973b44615e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.431569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1334/2673] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:26.441366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.442794 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.499518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa6c87-56ec-4e7d-9473-bc85a9a8a9c6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.503250 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bf960-f693-45ac-936f-f20a34819ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.503790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bf960-f693-45ac-936f-f20a34819ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.504068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bf960-f693-45ac-936f-f20a34819ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.504341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bf960-f693-45ac-936f-f20a34819ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.513148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bf960-f693-45ac-936f-f20a34819ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.514566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bf960-f693-45ac-936f-f20a34819ad3 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.524312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1340/2674] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:26.762933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197babb-429d-447d-9629-0973b44615e7 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:26.764353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2197babb-429d-447d-9629-0973b44615e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:26.780449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197babb-429d-447d-9629-0973b44615e7 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:26.785193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:26.785820 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.786091 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.786353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] PATH_INFO: `/v3/projects/c609695330394b9e80b9507af7b984b1` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:26.787552 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c609695330394b9e80b9507af7b984b1)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:26.789449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:26.887713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c609695330394b9e80b9507af7b984b1', 'request_id': 'req-294c8241-fad1-49e2-8d32-fd4ca3d0d426'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.955557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c609695330394b9e80b9507af7b984b1', 'request_id': 'req-294c8241-fad1-49e2-8d32-fd4ca3d0d426'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.961183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c609695330394b9e80b9507af7b984b1', 'request_id': 'req-294c8241-fad1-49e2-8d32-fd4ca3d0d426'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.972195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] The token cache is being invalidate because project c609695330394b9e80b9507af7b984b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:26.972473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.973080 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-294c8241-fad1-49e2-8d32-fd4ca3d0d426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:26.974530 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1335/2675] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:26 2022] DELETE /identity/v3/projects/c609695330394b9e80b9507af7b984b1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:26.980000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebe19-6bab-444d-a0ed-d084680cbba5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:26.980287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebe19-6bab-444d-a0ed-d084680cbba5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:26.980578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ebe19-6bab-444d-a0ed-d084680cbba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.000688 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f65ebe19-6bab-444d-a0ed-d084680cbba5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:27.004773 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f65ebe19-6bab-444d-a0ed-d084680cbba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.019292 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:27.060360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1341/2676] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:27.068710 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bd3f9-4551-4796-9f72-8834a93f5daf None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.068993 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bd3f9-4551-4796-9f72-8834a93f5daf None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.069261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bd3f9-4551-4796-9f72-8834a93f5daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.089893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-262bd3f9-4551-4796-9f72-8834a93f5daf None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:27.091150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-262bd3f9-4551-4796-9f72-8834a93f5daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.099286 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1336/2677] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:27.103655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ebe19-6bab-444d-a0ed-d084680cbba5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.113830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ebe19-6bab-444d-a0ed-d084680cbba5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.118888 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.119477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.119753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.120017 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.120678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:27.120971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.122547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.135850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1342/2678] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:27.140231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bd3f9-4551-4796-9f72-8834a93f5daf None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.149558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bd3f9-4551-4796-9f72-8834a93f5daf None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.154731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.155337 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.155751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.155908 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.156556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.158694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.163819 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:27.283200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1337/2679] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:27.287559 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.297792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e66396-073a-4d64-b208-67aa091e847c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.354262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.354885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.355163 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.355432 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.356050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.358020 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.465511 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1343/2680] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:27.470179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.480407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516352db-6c1b-4869-acd4-4103223061ce admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.485581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.486163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.486436 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.486716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.487386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.488967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.498540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1338/2681] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:27.502576 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.512624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225338c-8212-4ac1-b697-a1231631464e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.517210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714a031-f906-452f-9f41-b4673aadc782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.517825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a031-f906-452f-9f41-b4673aadc782 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.518102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a031-f906-452f-9f41-b4673aadc782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.518373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a031-f906-452f-9f41-b4673aadc782 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.519027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714a031-f906-452f-9f41-b4673aadc782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.520608 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714a031-f906-452f-9f41-b4673aadc782 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.532736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1344/2682] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:27.536890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.546658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef52e57-2e26-41c7-aa15-f7438d6bad7f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.551976 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.552610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.552881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.553147 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] PATH_INFO: `/v3/projects/3bc9325c80974c1d83c39dcb94dcb465/users/c59a531575d94e53994f1c1380166bc9/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.567250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc9325c80974c1d83c39dcb94dcb465, user_id=c59a531575d94e53994f1c1380166bc9, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.569905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.624424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1339/2683] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:27 2022] PUT /identity/v3/projects/3bc9325c80974c1d83c39dcb94dcb465/users/c59a531575d94e53994f1c1380166bc9/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:27.634932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d57833-2d8d-4ebc-a8fd-3bc79919592b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.635214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d57833-2d8d-4ebc-a8fd-3bc79919592b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.635477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d57833-2d8d-4ebc-a8fd-3bc79919592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.662806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-b0d57833-2d8d-4ebc-a8fd-3bc79919592b None None] MFA Rules not processed for user `c59a531575d94e53994f1c1380166bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:27.664005 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b0d57833-2d8d-4ebc-a8fd-3bc79919592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.730207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1345/2684] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:27.740652 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:27.742349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:27.798915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eda1df-0bf3-4735-82e0-ea78bc0ca007 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:27.802528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93c350-74ae-4b7f-933c-da7b13522b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:27.803169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c350-74ae-4b7f-933c-da7b13522b41 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:27.803467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c350-74ae-4b7f-933c-da7b13522b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:27.803731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93c350-74ae-4b7f-933c-da7b13522b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:27.811870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c350-74ae-4b7f-933c-da7b13522b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:27.813320 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93c350-74ae-4b7f-933c-da7b13522b41 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:27.821871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1340/2685] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:33.905385 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d57833-2d8d-4ebc-a8fd-3bc79919592b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:33.924648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:33.967683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d57833-2d8d-4ebc-a8fd-3bc79919592b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:33.972116 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:33.972733 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:33.973004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:33.973268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] PATH_INFO: `/v3/users/c59a531575d94e53994f1c1380166bc9` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:33.974361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59a531575d94e53994f1c1380166bc9)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:33.976322 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:34.113102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59a531575d94e53994f1c1380166bc9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.167367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59a531575d94e53994f1c1380166bc9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.167902 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59a531575d94e53994f1c1380166bc9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.175646 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59a531575d94e53994f1c1380166bc9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.187662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59a531575d94e53994f1c1380166bc9'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.193614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1346/2686] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:27:33 2022] DELETE /identity/v3/users/c59a531575d94e53994f1c1380166bc9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:34.198199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:34.198974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:34.199194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:34.218034 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:34.219717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:34.275446 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1341/2687] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:34.285729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:34.287214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:34.342717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072090c6-b5b9-4f87-8796-c9dd7b683a6e admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:34.346826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29227f1-ca33-4173-bd58-5441e8eac938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:34.347421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29227f1-ca33-4173-bd58-5441e8eac938 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:34.347694 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29227f1-ca33-4173-bd58-5441e8eac938 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:34.347963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29227f1-ca33-4173-bd58-5441e8eac938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:34.356678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29227f1-ca33-4173-bd58-5441e8eac938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:34.358099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29227f1-ca33-4173-bd58-5441e8eac938 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:34.367832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1347/2688] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:34.591773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:34.593243 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:34.606298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c2190-0c76-4ec9-b09e-4df630edd8be None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:34.611662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:34.612293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:34.612573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:34.612847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] PATH_INFO: `/v3/projects/3bc9325c80974c1d83c39dcb94dcb465` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:34.613969 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc9325c80974c1d83c39dcb94dcb465)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:34.616112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:34.700473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:34.701793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc9325c80974c1d83c39dcb94dcb465', 'request_id': 'req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.789398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc9325c80974c1d83c39dcb94dcb465', 'request_id': 'req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.795764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc9325c80974c1d83c39dcb94dcb465', 'request_id': 'req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.807125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] The token cache is being invalidate because project 3bc9325c80974c1d83c39dcb94dcb465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:27:34.807415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.808051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-afe6f16d-41d0-4c66-a6de-3451f7fe1daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:27:34.809535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1342/2689] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:27:34 2022] DELETE /identity/v3/projects/3bc9325c80974c1d83c39dcb94dcb465 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:34.814790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196cab-1e15-44ba-84ba-066b8139c11b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:34.815077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196cab-1e15-44ba-84ba-066b8139c11b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:34.815364 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196cab-1e15-44ba-84ba-066b8139c11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:34.835180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e9196cab-1e15-44ba-84ba-066b8139c11b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:34.836349 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e9196cab-1e15-44ba-84ba-066b8139c11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:34.870214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:34.896847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1348/2690] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:34.904764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbf993-947e-42f1-8daa-6397a0d3d0b3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:34.905045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbf993-947e-42f1-8daa-6397a0d3d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:34.905315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbf993-947e-42f1-8daa-6397a0d3d0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:34.924996 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7abbf993-947e-42f1-8daa-6397a0d3d0b3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:34.926203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7abbf993-947e-42f1-8daa-6397a0d3d0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:34.934213 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1343/2691] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:27:34.939038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196cab-1e15-44ba-84ba-066b8139c11b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:34.949143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196cab-1e15-44ba-84ba-066b8139c11b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:34.955295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:34.955938 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:34.956217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:34.956485 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:34.957119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:27:34.957445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:34.959076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:34.970302 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1349/2692] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:27:34.974551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbf993-947e-42f1-8daa-6397a0d3d0b3 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:34.983790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbf993-947e-42f1-8daa-6397a0d3d0b3 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:34.988598 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:34.989185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:34.989479 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:34.989743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:34.990392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:34.992352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.059458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1344/2693] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:34 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:35.064164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:35.074305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bc435-9685-4e1b-94b7-b828bfe0c4b3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:35.129625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:35.130225 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.130502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.130809 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.131450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:35.133352 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.201670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1350/2694] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:35 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:35.206340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:35.216668 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b24a9-17d9-4477-8bd3-493f86870baa admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:35.221197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:35.221791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.222092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.222357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.223017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:35.224600 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.234999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1345/2695] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:35.238862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:35.248839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928f6d5-aef6-429c-b2bf-47cc2faf85b3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:35.254167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369b865-9bc3-4c31-8b78-5f61f642e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:35.254789 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369b865-9bc3-4c31-8b78-5f61f642e435 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.255068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369b865-9bc3-4c31-8b78-5f61f642e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.255338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369b865-9bc3-4c31-8b78-5f61f642e435 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.255968 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369b865-9bc3-4c31-8b78-5f61f642e435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:35.257537 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369b865-9bc3-4c31-8b78-5f61f642e435 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.267867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1351/2696] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:35.271774 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:35.281593 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f3394-5756-45fc-aa7c-6d6ffc496d8e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:35.286275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:35.286950 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.287232 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.287501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] PATH_INFO: `/v3/projects/6ad7876c566f454096f2dfbd4485bf64/users/25841ff34aef4c5e9af919567723207a/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.302185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad7876c566f454096f2dfbd4485bf64, user_id=25841ff34aef4c5e9af919567723207a, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:35.304848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.361098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1346/2697] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:35 2022] PUT /identity/v3/projects/6ad7876c566f454096f2dfbd4485bf64/users/25841ff34aef4c5e9af919567723207a/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:35.366073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa10e3-92df-4bbb-9c65-81b214231d27 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.369778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa10e3-92df-4bbb-9c65-81b214231d27 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.369778 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa10e3-92df-4bbb-9c65-81b214231d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.386118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a2fa10e3-92df-4bbb-9c65-81b214231d27 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:35.387338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a2fa10e3-92df-4bbb-9c65-81b214231d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:35.446066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1352/2698] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:35.456036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:35.457727 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:35.514150 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c07867-1a49-46e4-9b91-41e22882f6b9 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:35.517746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:35.518335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:35.518605 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:35.518898 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:35.527674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:35.529097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:35.538412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1347/2699] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:40.956376 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920b4db-a2ab-4016-abdc-0d9b2ef3fa03 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:40.956891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920b4db-a2ab-4016-abdc-0d9b2ef3fa03 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:40.956891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920b4db-a2ab-4016-abdc-0d9b2ef3fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:40.987101 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e920b4db-a2ab-4016-abdc-0d9b2ef3fa03 None None] MFA Rules not processed for user `25841ff34aef4c5e9af919567723207a`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:40.988388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e920b4db-a2ab-4016-abdc-0d9b2ef3fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:41.144940 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:41.180429 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1353/2700] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:41.184890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:41.195465 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5a372-ca62-4cf5-a4cc-a6d227abe99b service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:41.201783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:41.202384 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:41.203669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:41.203942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:41.204735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:41.210002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:41.313679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1348/2701] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:27:41 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:27:41.317860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920b4db-a2ab-4016-abdc-0d9b2ef3fa03 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:41.329018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920b4db-a2ab-4016-abdc-0d9b2ef3fa03 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:41.389355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:41.389966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:41.390270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:41.390547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:41.391221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:41.393119 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:41.568351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1354/2702] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:27:41 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:27:41.572483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:41.583285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098b5e9-ed9f-41e4-9d3a-3bf92ef90913 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:41.588440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:41.589196 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:41.593283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:41.593283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:41.593283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:41.593283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:41.604246 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1349/2703] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:41.608518 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:41.619013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18679573-1eeb-4c24-9b73-aefafc1fa203 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:41.623766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:41.624430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:41.624709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:41.627745 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] PATH_INFO: `/v3/projects/a77b9b5cb00341f4b7cca959cc2e3c20/users/0777aef4cdce466bb4de2cea78c489b8/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:41.639693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77b9b5cb00341f4b7cca959cc2e3c20, user_id=0777aef4cdce466bb4de2cea78c489b8, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:41.642363 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:41.739768 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1355/2704] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:41 2022] PUT /identity/v3/projects/a77b9b5cb00341f4b7cca959cc2e3c20/users/0777aef4cdce466bb4de2cea78c489b8/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:41.743802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:41.753644 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a9b6b-5da4-4472-8fd0-7506932b9c4e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:41.795766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:41.812901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5990f4b-6478-4e37-9196-a9188621b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:41.813590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990f4b-6478-4e37-9196-a9188621b488 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:41.813858 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990f4b-6478-4e37-9196-a9188621b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:41.814068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990f4b-6478-4e37-9196-a9188621b488 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:41.814744 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5990f4b-6478-4e37-9196-a9188621b488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:41.816363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5990f4b-6478-4e37-9196-a9188621b488 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:41.831955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1350/2705] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:27:41.833210 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:41.844731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccecc00-29f3-43c7-bd0d-89173bc3a565 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:41.849504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:41.852501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:41.852501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:41.852501 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] PATH_INFO: `/v3/projects/a77b9b5cb00341f4b7cca959cc2e3c20/users/0777aef4cdce466bb4de2cea78c489b8/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:41.853583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77b9b5cb00341f4b7cca959cc2e3c20, user_id=0777aef4cdce466bb4de2cea78c489b8, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:41.856306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:41.868481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1356/2706] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:27:41 2022] PUT /identity/v3/projects/a77b9b5cb00341f4b7cca959cc2e3c20/users/0777aef4cdce466bb4de2cea78c489b8/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:27:47.306541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255b99-f352-45a5-8464-d1b717f76d98 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:47.307062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255b99-f352-45a5-8464-d1b717f76d98 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:47.307170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9255b99-f352-45a5-8464-d1b717f76d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:47.338749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b9255b99-f352-45a5-8464-d1b717f76d98 None None] MFA Rules not processed for user `0777aef4cdce466bb4de2cea78c489b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:47.339847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b9255b99-f352-45a5-8464-d1b717f76d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:47.424508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1351/2707] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:47.440817 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:47.442885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:47.539060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792fc66-0087-47cb-a300-6af68d95f44c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:47.545318 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:47.545932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:47.547231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:47.547231 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:47.574638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:47.610776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:47.612416 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:47.622989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1357/2708] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:47.754715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21171b-410a-46c5-bd70-bb2c9d2b8cc2 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:47.755001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21171b-410a-46c5-bd70-bb2c9d2b8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:47.755269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21171b-410a-46c5-bd70-bb2c9d2b8cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:47.775386 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7c21171b-410a-46c5-bd70-bb2c9d2b8cc2 None None] MFA Rules not processed for user `25841ff34aef4c5e9af919567723207a`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:27:47.776642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7c21171b-410a-46c5-bd70-bb2c9d2b8cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:47.783833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1352/2709] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:27:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:27:47.824917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:47.826306 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:47.911259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d00c2-d6d3-4f50-acf4-ae7ad42d0c63 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:47.914989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:47.915762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:47.917682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:47.917682 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:47.917883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:47.931513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:47.932926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:47.944558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1358/2710] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:27:48.580180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21171b-410a-46c5-bd70-bb2c9d2b8cc2 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:48.645367 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21171b-410a-46c5-bd70-bb2c9d2b8cc2 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:48.650865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:48.652050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:48.652336 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:48.652745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:48.656182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:48.672612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:48.674302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:48.710922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1353/2711] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:51.897526 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:27:51.899002 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:51.911462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71071f-08a5-49e8-88b8-a98e59517678 service glance] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:27:51.915305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271764-cee2-4a4e-9f1e-3d44a8d39259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:27:51.915991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271764-cee2-4a4e-9f1e-3d44a8d39259 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:27:51.916240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271764-cee2-4a4e-9f1e-3d44a8d39259 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:27:51.916504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271764-cee2-4a4e-9f1e-3d44a8d39259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:27:51.918274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-92271764-cee2-4a4e-9f1e-3d44a8d39259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:27:51.928448 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271764-cee2-4a4e-9f1e-3d44a8d39259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:27:51.929895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271764-cee2-4a4e-9f1e-3d44a8d39259 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:27:51.939016 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1359/2712] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:27:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:27:58.695607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=73 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:01.759733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:28:01.761118 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:01.816447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165ecd-71cc-4bef-b990-f2961649041a service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:28:01.820162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b18f309b5cb4641997b637f8f17ac87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:28:01.820753 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:01.821023 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:01.821289 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:01.830171 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:28:01.831617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:28:01.840817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1354/2713] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:28:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:28:01.934132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=57 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:11.836772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=26 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:31.948076 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b932-21e0-4ee5-bc95-dac961db0d4d None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:28:31.948625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b932-21e0-4ee5-bc95-dac961db0d4d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:28:31.948625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8b932-21e0-4ee5-bc95-dac961db0d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:28:31.968143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3dd8b932-21e0-4ee5-bc95-dac961db0d4d None None] MFA Rules not processed for user `25841ff34aef4c5e9af919567723207a`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:28:31.969299 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3dd8b932-21e0-4ee5-bc95-dac961db0d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:28:31.976184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1360/2714] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:28:41.962775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:12.029224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:12.041499 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ab30c-8d76-438d-b56a-5eb193f26201 service cinder] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:12.047698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:12.048288 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:12.048559 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:12.048821 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:12.050550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:12.063490 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:12.065141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:12.076015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1355/2715] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:14.385927 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:14.386444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:14.386444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:14.405188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] MFA Rules not processed for user `25841ff34aef4c5e9af919567723207a`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:29:14.406362 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:14.413255 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1361/2716] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:29:14.665691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:14.675624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7e92e-7062-4730-b739-9c5498c9cda6 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:14.679378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:14.679987 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:14.680266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:14.680538 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:14.684498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:14.692718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:14.694188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:14.702313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1356/2717] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:15.487290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:15.488693 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:15.558149 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d2f8-c73f-4611-b5f5-6de2e1b600b4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:15.563715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:15.564330 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:15.564601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:15.564866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:15.566624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:15.578774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:15.580317 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:15.589886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1362/2718] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:24.698919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=12 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:25.292343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:25.305517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c644-3c5d-4ca9-a7ce-f5904ea3fcb6 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:25.311895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:25.318031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:25.318031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:25.318031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:25.318031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:25.328415 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:25.329955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:25.340777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1357/2719] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:25.585874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=35 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:31.790081 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:29:31.803720 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf76361-fb11-43cc-8269-a1f61fdc63c5 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:29:31.810235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:29:31.811252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:29:31.811598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:29:31.811943 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:29:31.814339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:29:31.827271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:29:31.829851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:29:31.840787 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1363/2720] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:29:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:29:35.336234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:41.835928 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:06.181185 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:06.246181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254631-198b-4667-8570-936c2a208d07 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:06.251098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:06.251884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:06.252160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:06.252480 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] PATH_INFO: `/v3/users/25841ff34aef4c5e9af919567723207a` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:06.253694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] RBAC: Authorizing `identity:delete_user(user_id=25841ff34aef4c5e9af919567723207a)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:06.255675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:06.443695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25841ff34aef4c5e9af919567723207a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:06.511406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25841ff34aef4c5e9af919567723207a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:06.525074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25841ff34aef4c5e9af919567723207a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:06.525782 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25841ff34aef4c5e9af919567723207a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:06.533085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25841ff34aef4c5e9af919567723207a'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:06.539125 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1358/2721] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:30:06 2022] DELETE /identity/v3/users/25841ff34aef4c5e9af919567723207a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:06.786918 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:06.798303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd531ea-f798-443c-ad71-0cf9573ac9fa service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:06.858978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:06.859618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:06.859893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:06.860161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] PATH_INFO: `/v3/projects/6ad7876c566f454096f2dfbd4485bf64` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:06.861293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad7876c566f454096f2dfbd4485bf64)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:06.863747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:06.975222 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad7876c566f454096f2dfbd4485bf64', 'request_id': 'req-0579d805-c78e-4fe4-bc96-70b12c595915'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.025610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad7876c566f454096f2dfbd4485bf64', 'request_id': 'req-0579d805-c78e-4fe4-bc96-70b12c595915'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.032089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad7876c566f454096f2dfbd4485bf64', 'request_id': 'req-0579d805-c78e-4fe4-bc96-70b12c595915'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.043427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] The token cache is being invalidate because project 6ad7876c566f454096f2dfbd4485bf64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:30:07.043709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.044461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.045933 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1364/2722] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:30:06 2022] DELETE /identity/v3/projects/6ad7876c566f454096f2dfbd4485bf64 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:07.050595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:07.052119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:07.065785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8587d3-425e-4477-8cf4-9142c261dfda admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:07.124688 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:07.125330 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:07.125606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:07.125881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] PATH_INFO: `/v3/users/0777aef4cdce466bb4de2cea78c489b8` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:07.127116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0777aef4cdce466bb4de2cea78c489b8)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:07.129707 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:07.158812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:07.325783 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0777aef4cdce466bb4de2cea78c489b8'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.417863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0777aef4cdce466bb4de2cea78c489b8'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.431860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0777aef4cdce466bb4de2cea78c489b8'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.432566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0777aef4cdce466bb4de2cea78c489b8'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.439620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-e4253b2d-ca2c-4e32-b830-6730284f0840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0777aef4cdce466bb4de2cea78c489b8'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.445896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1359/2723] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:30:07 2022] DELETE /identity/v3/users/0777aef4cdce466bb4de2cea78c489b8 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:07.707858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:07.709972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:07.724023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579d805-c78e-4fe4-bc96-70b12c595915 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:07.804844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:07.807346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:07.807346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:07.807346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] PATH_INFO: `/v3/projects/a77b9b5cb00341f4b7cca959cc2e3c20` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:07.807346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77b9b5cb00341f4b7cca959cc2e3c20)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:07.809087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:07.898839 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:07.911455 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77b9b5cb00341f4b7cca959cc2e3c20', 'request_id': 'req-161abd71-a91d-4b40-852b-676e11d3235e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.978012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77b9b5cb00341f4b7cca959cc2e3c20', 'request_id': 'req-161abd71-a91d-4b40-852b-676e11d3235e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.984190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77b9b5cb00341f4b7cca959cc2e3c20', 'request_id': 'req-161abd71-a91d-4b40-852b-676e11d3235e'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.996372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] The token cache is being invalidate because project a77b9b5cb00341f4b7cca959cc2e3c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:30:07.996655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.997304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-161abd71-a91d-4b40-852b-676e11d3235e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:30:07.998827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1365/2724] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:30:07 2022] DELETE /identity/v3/projects/a77b9b5cb00341f4b7cca959cc2e3c20 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:08.004247 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e09c6-e067-4ee0-8340-59577fc48564 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.004563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e09c6-e067-4ee0-8340-59577fc48564 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.004846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e09c6-e067-4ee0-8340-59577fc48564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.025007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a89e09c6-e067-4ee0-8340-59577fc48564 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:08.026219 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a89e09c6-e067-4ee0-8340-59577fc48564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.085373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1360/2725] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:08.093366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121992-891f-47cb-a5f8-2fd2c888fb64 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.093647 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121992-891f-47cb-a5f8-2fd2c888fb64 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.093917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121992-891f-47cb-a5f8-2fd2c888fb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.113451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cc121992-891f-47cb-a5f8-2fd2c888fb64 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:08.114629 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cc121992-891f-47cb-a5f8-2fd2c888fb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.122366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1366/2726] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:08.126765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e09c6-e067-4ee0-8340-59577fc48564 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.137103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e09c6-e067-4ee0-8340-59577fc48564 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.146882 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.147525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.147799 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.148083 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.148733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:30:08.149028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.150634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.163005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1361/2727] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:30:08.167489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121992-891f-47cb-a5f8-2fd2c888fb64 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.176529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121992-891f-47cb-a5f8-2fd2c888fb64 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.181099 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.181683 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.181954 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.182217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.182863 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.184744 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.295534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1367/2728] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:30:08.299630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.309713 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2869267-f3f2-468a-84ed-38f7c33cf496 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.368316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.369042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.369174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.369440 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.370069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.372087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.447901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1362/2729] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:30:08.452297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.462952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba24e-0840-4968-aa1d-5730f0743cd6 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.467763 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.468350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.468621 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.468885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.469639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.471247 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.481032 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1368/2730] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:30:08.485028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.495508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d5dfd-b4ed-4995-afca-3150047a87c8 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.500311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a98070-ed13-462e-bc07-1b6b948c4223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.500920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98070-ed13-462e-bc07-1b6b948c4223 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.501193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98070-ed13-462e-bc07-1b6b948c4223 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.501462 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98070-ed13-462e-bc07-1b6b948c4223 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.502131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98070-ed13-462e-bc07-1b6b948c4223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.504424 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98070-ed13-462e-bc07-1b6b948c4223 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.514256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1363/2731] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:30:08.518813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.528372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7210-deb6-4ead-8eb2-abde9e3760ab admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.534605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.535284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.535562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.535837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] PATH_INFO: `/v3/projects/6e0c22d8014545b8a65dc7ad268f8472/users/77d2ae52b18d432a9f0dd9cd85a4e390/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.550217 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0c22d8014545b8a65dc7ad268f8472, user_id=77d2ae52b18d432a9f0dd9cd85a4e390, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.552844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.617083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1369/2732] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:30:08 2022] PUT /identity/v3/projects/6e0c22d8014545b8a65dc7ad268f8472/users/77d2ae52b18d432a9f0dd9cd85a4e390/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:30:08.622285 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2def4-3415-4505-8ca1-12845e6689c3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.622613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2def4-3415-4505-8ca1-12845e6689c3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.622919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2def4-3415-4505-8ca1-12845e6689c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.631029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:08.642287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e3f2def4-3415-4505-8ca1-12845e6689c3 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:08.644007 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e3f2def4-3415-4505-8ca1-12845e6689c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.702787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1364/2733] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:08.712991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:08.716700 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:08.772859 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9bc14-af3b-4b6c-bbb9-899f7a202d62 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:08.776438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:08.777026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:08.777297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:08.777563 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:08.786279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:08.787784 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:08.796799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1370/2734] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:14.245766 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfca2-c4c2-47c2-8c82-34ad3e2ce259 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.246296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfca2-c4c2-47c2-8c82-34ad3e2ce259 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.246296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bfca2-c4c2-47c2-8c82-34ad3e2ce259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.280353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-772bfca2-c4c2-47c2-8c82-34ad3e2ce259 None None] MFA Rules not processed for user `77d2ae52b18d432a9f0dd9cd85a4e390`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:14.281767 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-772bfca2-c4c2-47c2-8c82-34ad3e2ce259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:14.351421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1365/2735] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:30:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:14.355963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:14.365874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146a51d-d373-4183-baa2-6d942e91cf18 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:14.370887 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:14.371488 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.371766 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.372033 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.372701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:14.374588 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.495932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1371/2736] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:30:14 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:30:14.499967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bfca2-c4c2-47c2-8c82-34ad3e2ce259 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:14.511065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bfca2-c4c2-47c2-8c82-34ad3e2ce259 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:14.567048 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:14.567946 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.568218 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.568482 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.569103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:14.571089 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.642120 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1366/2737] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:30:14 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:30:14.646844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:14.656834 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03014f6b-5e03-45f7-a760-f7435f24b119 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:14.662038 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:14.662634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.662919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.663181 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.663806 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:14.665379 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.675741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1372/2738] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:30:14.680417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:14.690576 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be18a8-1b45-4d85-b881-803c31b6a393 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:14.695457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:14.696099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.696374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.696643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] PATH_INFO: `/v3/projects/82e3180ab0034cdb8d41b241b984022b/users/9f8ee4ed5d0a44aaa186823b4fcc1e9b/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.712932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e3180ab0034cdb8d41b241b984022b, user_id=9f8ee4ed5d0a44aaa186823b4fcc1e9b, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:14.715718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.778619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:14.783392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1367/2739] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:30:14 2022] PUT /identity/v3/projects/82e3180ab0034cdb8d41b241b984022b/users/9f8ee4ed5d0a44aaa186823b4fcc1e9b/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:14.787665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:14.798094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f5032-bdd0-46f0-8555-fd63aac9e1df admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:14.821919 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:14.853475 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e408e0-646b-43b5-8a25-e104e92ea19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:14.854068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e408e0-646b-43b5-8a25-e104e92ea19d admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.854337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e408e0-646b-43b5-8a25-e104e92ea19d admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.854602 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e408e0-646b-43b5-8a25-e104e92ea19d admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.855270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e408e0-646b-43b5-8a25-e104e92ea19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:14.856822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e408e0-646b-43b5-8a25-e104e92ea19d admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.867192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1373/2740] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:30:14.871549 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:14.882590 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692348-cf13-48f9-9314-2c119ed3bdee admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:14.887261 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:14.887902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:14.888176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:14.888443 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] PATH_INFO: `/v3/projects/82e3180ab0034cdb8d41b241b984022b/users/9f8ee4ed5d0a44aaa186823b4fcc1e9b/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:14.890491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e3180ab0034cdb8d41b241b984022b, user_id=9f8ee4ed5d0a44aaa186823b4fcc1e9b, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:14.894177 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:14.905524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1368/2741] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:30:14 2022] PUT /identity/v3/projects/82e3180ab0034cdb8d41b241b984022b/users/9f8ee4ed5d0a44aaa186823b4fcc1e9b/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:30:20.794557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760c73-e6c2-4e2c-b418-bc25edbe040e None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:20.795143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760c73-e6c2-4e2c-b418-bc25edbe040e None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:20.795254 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760c73-e6c2-4e2c-b418-bc25edbe040e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:20.830836 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0b760c73-e6c2-4e2c-b418-bc25edbe040e None None] MFA Rules not processed for user `9f8ee4ed5d0a44aaa186823b4fcc1e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:20.832601 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0b760c73-e6c2-4e2c-b418-bc25edbe040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:20.908931 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1374/2742] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:30:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:20.922362 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:20.924866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:20.981588 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53c835-4950-44cf-968d-896b14e671bb admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:20.985186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:20.985786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:20.986717 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:20.986994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:21.043751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:21.045322 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:21.055013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1369/2743] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:30:21.382238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77dec8-018a-49cd-a46d-606909ed2265 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:21.382849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77dec8-018a-49cd-a46d-606909ed2265 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:21.383178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77dec8-018a-49cd-a46d-606909ed2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:21.460021 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4f77dec8-018a-49cd-a46d-606909ed2265 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:21.461240 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4f77dec8-018a-49cd-a46d-606909ed2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:21.538480 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1375/2744] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:30:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:21.583651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:21.585161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:21.692399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741570ac-4f46-4a8f-9c21-e9624614b58b service glance] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:21.697765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e6c8f-ab92-4507-ae41-1f6f939f6e58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:21.698365 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e6c8f-ab92-4507-ae41-1f6f939f6e58 service swift] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:21.703408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e6c8f-ab92-4507-ae41-1f6f939f6e58 service swift] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:21.703408 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e6c8f-ab92-4507-ae41-1f6f939f6e58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:21.709874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e6c8f-ab92-4507-ae41-1f6f939f6e58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:21.711541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e6c8f-ab92-4507-ae41-1f6f939f6e58 service swift] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:21.720092 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1370/2745] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:30:31.535579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:31.716662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:32.609313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554f55-4cce-4dc3-ab1d-85ae6783494b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:32.609949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554f55-4cce-4dc3-ab1d-85ae6783494b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:32.610065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c554f55-4cce-4dc3-ab1d-85ae6783494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:32.636027 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-0c554f55-4cce-4dc3-ab1d-85ae6783494b None None] MFA Rules not processed for user `77d2ae52b18d432a9f0dd9cd85a4e390`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:32.639135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0c554f55-4cce-4dc3-ab1d-85ae6783494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:32.644392 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1376/2746] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:30:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:36.364617 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:36.365160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:36.365160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:36.386907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:30:36.388158 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:30:36.396724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1371/2747] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:30:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:30:36.410258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c554f55-4cce-4dc3-ab1d-85ae6783494b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:30:36.423344 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c554f55-4cce-4dc3-ab1d-85ae6783494b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:30:36.429443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:30:36.430068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:30:36.430345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:30:36.430616 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:30:36.440781 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:30:36.442643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:30:36.452451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1377/2748] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:30:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:30:46.380270 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:46.448098 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=9 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:11.534409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:11.535817 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:11.594523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e58c1-bc6a-498c-898f-a478fe80e3b1 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:11.598188 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:11.598906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:11.599226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:11.599489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:11.608629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:11.610657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:11.619692 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1372/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:31:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:31:13.527636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:31:13.529191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:13.607610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d016996-b1c4-474a-aedb-9efc63c88297 service swift] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:31:13.613304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:31:13.613926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:31:13.614202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:31:13.614469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:31:13.616443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:31:13.629944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:31:13.633206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:31:13.646030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1378/2750] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:31:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:31:21.615277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=26 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:23.639304 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=34 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:53.139536 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:53.175927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f00479-f058-418c-87c0-56f7487ff9fa service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:53.179581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:53.183382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:53.183382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:53.183382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:53.183382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:53.227705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:53.229143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:53.241008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1373/2751] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:32:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:32:53.300603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:53.320660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d5f9-0b93-46b9-b7d9-7251dd5c342d service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:53.324963 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:53.325560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:53.325830 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:53.326094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:53.327882 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:53.351067 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:53.352499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:53.361271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1379/2752] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:32:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:32:54.606117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:32:54.614920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e47320-36b6-4ee8-90a8-c5896c41f3ef service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:32:54.618431 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53748ea5-acf3-4ede-944b-e5901f692af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:32:54.619057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53748ea5-acf3-4ede-944b-e5901f692af1 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:32:54.619341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53748ea5-acf3-4ede-944b-e5901f692af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:32:54.619643 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53748ea5-acf3-4ede-944b-e5901f692af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:32:54.621358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-53748ea5-acf3-4ede-944b-e5901f692af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:32:54.634324 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53748ea5-acf3-4ede-944b-e5901f692af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:32:54.636305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53748ea5-acf3-4ede-944b-e5901f692af1 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:32:54.647010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1374/2753] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:32:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:33:03.357092 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=16 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:04.642204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=37 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:15.059548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:15.062332 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:15.090972 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2eb15-3661-480f-be99-a330f2c21a90 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:15.098547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:15.099461 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:15.099998 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:15.100433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:15.103041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:15.128192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:15.130571 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:15.153370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1380/2754] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:25.140401 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:29.661293 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8e00-af06-4bbd-ae67-74878cfc9980 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:29.667088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8e00-af06-4bbd-ae67-74878cfc9980 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:29.667088 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8e00-af06-4bbd-ae67-74878cfc9980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:29.682173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1ffd8e00-af06-4bbd-ae67-74878cfc9980 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:29.683492 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1ffd8e00-af06-4bbd-ae67-74878cfc9980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:29.690765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1375/2755] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 10:34:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:29.738582 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:29.750390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3d74-28ca-4fd5-9918-11de871ec49a service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:29.755560 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:29.756148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:29.756420 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:29.756686 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:29.764637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:29.766190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:29.775366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1381/2756] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:34:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 10:34:31.004378 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:31.012392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:31.012392 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:31.025319 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:31.026491 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:31.033888 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1376/2757] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:34:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:31.046089 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:31.057400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576d5f5-7463-4a23-bb64-0be896a71adb service swift] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:31.063676 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a5200-7ce9-41c8-977e-32bcf5a0004f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:31.064275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5200-7ce9-41c8-977e-32bcf5a0004f service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:31.064548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5200-7ce9-41c8-977e-32bcf5a0004f service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:31.064813 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a5200-7ce9-41c8-977e-32bcf5a0004f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:31.075070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5200-7ce9-41c8-977e-32bcf5a0004f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:31.076649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a5200-7ce9-41c8-977e-32bcf5a0004f service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:31.085558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1382/2758] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:35.795467 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:35.797174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:35.935878 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4cc2b-f6ba-48f3-ba63-5bb8803072a3 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:35.943476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:35.944109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:35.944398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:35.944738 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:35.946560 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:35.959347 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:35.961021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:35.976231 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1377/2759] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:34:41.081966 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:41.565895 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316c46a-4aec-4e34-b887-904f81455e72 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:41.568331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316c46a-4aec-4e34-b887-904f81455e72 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:41.568331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316c46a-4aec-4e34-b887-904f81455e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:41.586736 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-3316c46a-4aec-4e34-b887-904f81455e72 None None] MFA Rules not processed for user `77d2ae52b18d432a9f0dd9cd85a4e390`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:41.587939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-3316c46a-4aec-4e34-b887-904f81455e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:41.594999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1383/2760] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:34:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:34:41.866751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:41.876906 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4291-a769-42c1-9451-4a229bb58938 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:41.880884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f88622-b7cf-40da-9ee4-5798e920b386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:41.881494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88622-b7cf-40da-9ee4-5798e920b386 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:41.881749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88622-b7cf-40da-9ee4-5798e920b386 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:41.882010 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88622-b7cf-40da-9ee4-5798e920b386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:41.884302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-42f88622-b7cf-40da-9ee4-5798e920b386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:41.897511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f88622-b7cf-40da-9ee4-5798e920b386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:41.899013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f88622-b7cf-40da-9ee4-5798e920b386 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:41.910142 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1378/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:34:42.661280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316c46a-4aec-4e34-b887-904f81455e72 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:42.680221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316c46a-4aec-4e34-b887-904f81455e72 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:42.686913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:42.687853 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:42.688294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:42.688561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:42.690389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:42.703183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:42.705014 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:42.716709 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1384/2762] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:34:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:34:45.831684 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04e55-9b60-48ca-9d77-521b5cb79130 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:45.832423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04e55-9b60-48ca-9d77-521b5cb79130 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:45.832423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04e55-9b60-48ca-9d77-521b5cb79130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:45.853244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-31a04e55-9b60-48ca-9d77-521b5cb79130 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:34:45.856835 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-31a04e55-9b60-48ca-9d77-521b5cb79130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:34:45.865115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1379/2763] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:34:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:34:45.878891 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:34:45.890958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a147a8b-bde2-4860-b375-8a55ec1b7ba5 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:34:45.896275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:34:45.897088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:34:45.897369 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:34:45.897641 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:34:45.908036 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:34:45.914174 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:34:45.918848 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1385/2764] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:34:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:55.847885 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=56 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:55.915328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=15 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:00.839387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04e55-9b60-48ca-9d77-521b5cb79130 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:35:00.852357 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04e55-9b60-48ca-9d77-521b5cb79130 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:35:00.859459 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:35:00.860112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:35:00.860486 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:35:00.860854 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:35:00.863062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:35:00.876905 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:35:00.878537 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:35:00.890975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1380/2765] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:35:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:35:10.886209 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:20.154395 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:35:20.164842 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5d6ee-fa54-460a-a194-c9b1a6e8a562 service swift] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:35:20.168635 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c4bf-a0b6-48b5-8cbf-0fca750c384e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:35:20.169235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c4bf-a0b6-48b5-8cbf-0fca750c384e service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:35:20.169510 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c4bf-a0b6-48b5-8cbf-0fca750c384e service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:35:20.169799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c4bf-a0b6-48b5-8cbf-0fca750c384e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:35:20.180090 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859c4bf-a0b6-48b5-8cbf-0fca750c384e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:35:20.181553 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859c4bf-a0b6-48b5-8cbf-0fca750c384e service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:35:20.191648 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1386/2766] 10.222.0.49 () {60 vars in 1396 bytes} [Fri Oct 28 10:35:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:35:30.186591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:26.334047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:26.348197 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b6e8f-ab91-4e63-89ac-3a373bb9b66d service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:26.358842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:26.359912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:26.360397 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:26.361050 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:26.373039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:26.377029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:26.389352 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1381/2767] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:36.382998 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:44.602885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95996ed-c0ba-4f07-b40a-61d57f092dca None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:44.610614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95996ed-c0ba-4f07-b40a-61d57f092dca None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:44.610614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95996ed-c0ba-4f07-b40a-61d57f092dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:44.623558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-f95996ed-c0ba-4f07-b40a-61d57f092dca None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:44.624742 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f95996ed-c0ba-4f07-b40a-61d57f092dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:44.639999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1387/2768] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:44.690788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:44.703311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1bc59-2bc9-4440-85cc-bf1ed11c1913 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:44.708468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:44.709064 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:44.709340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:44.709607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:44.718437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:44.720097 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:44.728343 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1382/2769] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:36:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:36:45.793910 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95996ed-c0ba-4f07-b40a-61d57f092dca None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:45.804805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95996ed-c0ba-4f07-b40a-61d57f092dca None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:45.809018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:45.809624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:45.809900 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:45.810698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:45.891907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:45.893251 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:45.911983 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1388/2770] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:49.580434 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:49.581911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:49.601275 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa570c-2a08-49d0-b3cf-78a178fb0b4c service swift] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:49.609872 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:49.610991 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:49.611473 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:49.611938 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:49.614901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:49.635422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:49.638226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:49.655280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1383/2771] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:53.867984 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:53.882011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6addc-94a5-46ca-8b54-39b9122b4487 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:53.891162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:53.891786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:53.892202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:53.892554 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:53.894547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:53.908284 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:53.909985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:53.921350 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1389/2772] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:36:54.057194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:54.064223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bdfd3-9df2-4743-bcc2-5ccf41b6de82 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:54.069349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:54.069986 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:54.070271 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:54.070630 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] PATH_INFO: `/v3/users/77d2ae52b18d432a9f0dd9cd85a4e390` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:54.071824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d2ae52b18d432a9f0dd9cd85a4e390)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:54.073765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:54.349683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d2ae52b18d432a9f0dd9cd85a4e390'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:54.449039 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d2ae52b18d432a9f0dd9cd85a4e390'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:54.466881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d2ae52b18d432a9f0dd9cd85a4e390'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:54.467589 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d2ae52b18d432a9f0dd9cd85a4e390'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:54.474789 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d2ae52b18d432a9f0dd9cd85a4e390'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:54.480895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1384/2773] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:36:54 2022] DELETE /identity/v3/users/77d2ae52b18d432a9f0dd9cd85a4e390 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:54.781533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:54.793093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef0be4-d9a8-4801-a193-b55afe5c035e service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:54.860505 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:54.861052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:54.861334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:54.861595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] PATH_INFO: `/v3/projects/6e0c22d8014545b8a65dc7ad268f8472` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:54.862793 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0c22d8014545b8a65dc7ad268f8472)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:54.864680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:54.990528 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0c22d8014545b8a65dc7ad268f8472', 'request_id': 'req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:54.993123 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:55.100490 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0c22d8014545b8a65dc7ad268f8472', 'request_id': 'req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.106932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0c22d8014545b8a65dc7ad268f8472', 'request_id': 'req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.134065 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] The token cache is being invalidate because project 6e0c22d8014545b8a65dc7ad268f8472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:36:55.134373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.134908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.136572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1390/2774] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:36:54 2022] DELETE /identity/v3/projects/6e0c22d8014545b8a65dc7ad268f8472 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:55.141797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:55.143340 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:55.157501 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf124d4-b3f6-48a1-8e49-bbba61f832cf admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:55.241203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:55.241841 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:55.242117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:55.242387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] PATH_INFO: `/v3/users/9f8ee4ed5d0a44aaa186823b4fcc1e9b` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:55.243565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8ee4ed5d0a44aaa186823b4fcc1e9b)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:55.245488 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:55.457238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8ee4ed5d0a44aaa186823b4fcc1e9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.459134 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:55.547355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8ee4ed5d0a44aaa186823b4fcc1e9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.564581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8ee4ed5d0a44aaa186823b4fcc1e9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.565276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8ee4ed5d0a44aaa186823b4fcc1e9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.574081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-ba660408-3573-48fa-87e8-4019aa8d4651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8ee4ed5d0a44aaa186823b4fcc1e9b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:55.581186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1385/2775] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:36:55 2022] DELETE /identity/v3/users/9f8ee4ed5d0a44aaa186823b4fcc1e9b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:55.898325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:55.904760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:55.915228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b050-dd70-41ad-a3b3-a9a99f28ab0c admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:55.983721 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:55.984262 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:55.984547 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:55.984827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] PATH_INFO: `/v3/projects/82e3180ab0034cdb8d41b241b984022b` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:55.985926 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e3180ab0034cdb8d41b241b984022b)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:55.987847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:56.152920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e3180ab0034cdb8d41b241b984022b', 'request_id': 'req-ff136efb-7226-46e1-8294-812b2c000712'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:56.289777 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e3180ab0034cdb8d41b241b984022b', 'request_id': 'req-ff136efb-7226-46e1-8294-812b2c000712'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:56.305468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e3180ab0034cdb8d41b241b984022b', 'request_id': 'req-ff136efb-7226-46e1-8294-812b2c000712'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:56.312672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] The token cache is being invalidate because project 82e3180ab0034cdb8d41b241b984022b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:36:56.312952 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:56.313690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-ff136efb-7226-46e1-8294-812b2c000712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:36:56.315361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1391/2776] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:36:55 2022] DELETE /identity/v3/projects/82e3180ab0034cdb8d41b241b984022b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:36:56.321284 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1527f-07f0-4687-a4dc-bfe4899a1537 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:56.322021 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1527f-07f0-4687-a4dc-bfe4899a1537 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:56.322250 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1527f-07f0-4687-a4dc-bfe4899a1537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:56.409612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-cee1527f-07f0-4687-a4dc-bfe4899a1537 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:56.410915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cee1527f-07f0-4687-a4dc-bfe4899a1537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:56.496301 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1386/2777] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:56.508729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64d9d-1902-4bda-aa56-7eb4d93e0c89 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:56.509077 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64d9d-1902-4bda-aa56-7eb4d93e0c89 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:56.509358 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64d9d-1902-4bda-aa56-7eb4d93e0c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:56.531329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-4cb64d9d-1902-4bda-aa56-7eb4d93e0c89 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:56.532533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4cb64d9d-1902-4bda-aa56-7eb4d93e0c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:56.540729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1392/2778] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:56.545204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1527f-07f0-4687-a4dc-bfe4899a1537 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:56.555409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1527f-07f0-4687-a4dc-bfe4899a1537 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:56.564685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:56.565422 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:56.565745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:56.566051 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:56.566785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:36:56.567127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:56.569203 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:56.588437 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1387/2779] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:36:56.594386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64d9d-1902-4bda-aa56-7eb4d93e0c89 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:56.605598 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64d9d-1902-4bda-aa56-7eb4d93e0c89 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:56.611039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:56.611638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:56.611914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:56.612180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:56.612807 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:56.614747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:56.788339 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1393/2780] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:36:56 2022] POST /identity/v3/projects => generated 393 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:36:56.802353 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:56.811534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b46ec8-d1f2-4002-ac3c-83788f509583 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:56.879714 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:56.880611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:56.881099 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:56.881570 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:56.882646 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:56.885506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:56.978923 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1388/2781] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:36:56 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:36:56.984253 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:56.995443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe3ba6-9f7c-4725-a4d1-b2a072b02602 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.000402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.001006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.001279 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.001539 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.002183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.003877 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.014445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1394/2782] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:36:57.018768 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.029787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d6eb-1276-41f2-8a10-a7caf21eef24 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.034535 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f45eb0-d5eb-4cf2-bdbf-90f743fd8097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.035239 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f45eb0-d5eb-4cf2-bdbf-90f743fd8097 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.035518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f45eb0-d5eb-4cf2-bdbf-90f743fd8097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.035940 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f45eb0-d5eb-4cf2-bdbf-90f743fd8097 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.036583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f45eb0-d5eb-4cf2-bdbf-90f743fd8097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.038254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f45eb0-d5eb-4cf2-bdbf-90f743fd8097 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.044274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:57.050529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1389/2783] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:36:57.054881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.065312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676bd0-f0c9-4320-9246-e26552408119 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.069879 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.072122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.072122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.072122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] PATH_INFO: `/v3/projects/24e3e3be476740a381e69dd04b21c017/users/7894de8aef044b739ee9bf69051951f0/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.083436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:57.097530 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e3e3be476740a381e69dd04b21c017, user_id=7894de8aef044b739ee9bf69051951f0, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.100607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.164324 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1395/2784] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:36:57 2022] PUT /identity/v3/projects/24e3e3be476740a381e69dd04b21c017/users/7894de8aef044b739ee9bf69051951f0/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:57.175978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0f5fa-3d8a-41d9-84ff-a775e9bfdd0e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.176258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0f5fa-3d8a-41d9-84ff-a775e9bfdd0e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.176523 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0f5fa-3d8a-41d9-84ff-a775e9bfdd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.205824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-06f0f5fa-3d8a-41d9-84ff-a775e9bfdd0e None None] MFA Rules not processed for user `7894de8aef044b739ee9bf69051951f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:57.207144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-06f0f5fa-3d8a-41d9-84ff-a775e9bfdd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:57.281005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1390/2785] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:36:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:57.285896 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.354000 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07168a7-a27f-43cd-95be-bce799d84022 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.361925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.362772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.363144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.363575 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.364394 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.366433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.463031 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1396/2786] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:36:57 2022] POST /identity/v3/projects => generated 391 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:36:57.468245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0f5fa-3d8a-41d9-84ff-a775e9bfdd0e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.479968 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0f5fa-3d8a-41d9-84ff-a775e9bfdd0e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.548178 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.549133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.549573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.550018 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.551639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.554776 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.679920 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1391/2787] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:36:57 2022] POST /identity/v3/users => generated 302 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:36:57.684578 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.702403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82aa31-969c-4afb-8c54-59efa1622c81 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.707572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.708158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.708431 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.708724 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.709359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.711024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.722964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1397/2788] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:36:57.727680 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.739077 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d8d51-d20e-41dd-ad3a-85455f636bd5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.744327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.744995 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.745254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.745528 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] PATH_INFO: `/v3/projects/21974acd2bfa4d1c97d7fa24a3afb8be/users/6b62e3c6e9aa4228abd5ab01a58d1179/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.762070 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21974acd2bfa4d1c97d7fa24a3afb8be, user_id=6b62e3c6e9aa4228abd5ab01a58d1179, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.764867 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.837945 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1392/2789] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:36:57 2022] PUT /identity/v3/projects/21974acd2bfa4d1c97d7fa24a3afb8be/users/6b62e3c6e9aa4228abd5ab01a58d1179/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:57.845484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.856035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69fcd-2b0e-44e6-817f-f878619758f2 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.921316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e8910-b13e-45ef-bc1d-8572224a4e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.921909 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e8910-b13e-45ef-bc1d-8572224a4e11 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.922209 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e8910-b13e-45ef-bc1d-8572224a4e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.922465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e8910-b13e-45ef-bc1d-8572224a4e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.923290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e8910-b13e-45ef-bc1d-8572224a4e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.924885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e8910-b13e-45ef-bc1d-8572224a4e11 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.935115 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1398/2790] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 10:36:57.940179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:57.951824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44b0f-a04a-429c-a6da-5fcfe17fa05a admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:57.956760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:57.957421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.957694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.957964 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] PATH_INFO: `/v3/projects/21974acd2bfa4d1c97d7fa24a3afb8be/users/6b62e3c6e9aa4228abd5ab01a58d1179/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:57.959981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=21974acd2bfa4d1c97d7fa24a3afb8be, user_id=6b62e3c6e9aa4228abd5ab01a58d1179, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:57.962844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:57.979925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1393/2791] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:36:57 2022] PUT /identity/v3/projects/21974acd2bfa4d1c97d7fa24a3afb8be/users/6b62e3c6e9aa4228abd5ab01a58d1179/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:36:57.998321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:57.998888 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:57.999366 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:58.038985 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] MFA Rules not processed for user `6b62e3c6e9aa4228abd5ab01a58d1179`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:36:58.040192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:58.093438 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:58.131398 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1399/2792] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:36:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:36:58.147327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:36:58.149525 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:36:58.203791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:58.259565 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54360148-756b-4d5d-b93a-a0ab911970ac admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:36:58.265733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629b9c-5b7d-4a62-9738-ccee88011fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:36:58.266750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629b9c-5b7d-4a62-9738-ccee88011fc9 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:36:58.267477 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629b9c-5b7d-4a62-9738-ccee88011fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:36:58.267875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629b9c-5b7d-4a62-9738-ccee88011fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:36:58.331095 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629b9c-5b7d-4a62-9738-ccee88011fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:36:58.333844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629b9c-5b7d-4a62-9738-ccee88011fc9 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:36:58.344377 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1394/2793] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:36:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:04.064729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:04.066207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:04.137133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cc8c1-2657-4d18-8511-5b899e7499e8 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:04.145406 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:04.146024 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:04.146308 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:04.146580 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:04.157388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:04.158885 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:04.169585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1400/2794] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:07.731509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56f6d0-8ed8-433e-87be-9f87cdcca096 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:07.732184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56f6d0-8ed8-433e-87be-9f87cdcca096 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:07.732184 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56f6d0-8ed8-433e-87be-9f87cdcca096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:07.757193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-3d56f6d0-8ed8-433e-87be-9f87cdcca096 None None] MFA Rules not processed for user `7894de8aef044b739ee9bf69051951f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:37:07.758421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3d56f6d0-8ed8-433e-87be-9f87cdcca096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:07.767351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1395/2795] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:37:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:37:08.212226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:37:08.223856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aed232-9cb0-4ef2-b769-b0375a35adb8 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:37:08.228798 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:37:08.230443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:37:08.231030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:37:08.231348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:37:08.234069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:37:08.246792 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:37:08.250170 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:37:08.265330 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1401/2796] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:37:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:37:17.749028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=49 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:18.258383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=40 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:00.528449 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56f6d0-8ed8-433e-87be-9f87cdcca096 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:38:00.540252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56f6d0-8ed8-433e-87be-9f87cdcca096 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:38:00.544697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:38:00.546363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:38:00.546363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:38:00.546363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:38:00.547899 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:00.562241 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:38:00.563949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:38:00.576917 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1396/2797] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:38:01.772685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:38:01.782869 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19424fd-9341-4406-9976-b7119338590f service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:38:01.786548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9d0e8-72c6-4f81-add1-e7803e6db220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:38:01.787204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d0e8-72c6-4f81-add1-e7803e6db220 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:38:01.787481 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d0e8-72c6-4f81-add1-e7803e6db220 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:38:01.787752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9d0e8-72c6-4f81-add1-e7803e6db220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:38:01.789466 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b0b9d0e8-72c6-4f81-add1-e7803e6db220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:01.803019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9d0e8-72c6-4f81-add1-e7803e6db220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:38:01.804627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9d0e8-72c6-4f81-add1-e7803e6db220 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:38:01.816072 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1402/2798] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:38:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:38:06.690162 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:38:06.691843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:06.703454 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4fa1d-4998-4a67-97e0-6987d878d8df service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:38:06.708031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:38:06.708694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:38:06.708971 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:38:06.709234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:38:06.712369 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:06.723355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:38:06.724804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:38:06.736502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1397/2799] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:38:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:38:11.811259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:16.730983 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=12 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:27.871548 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db082c31-0d1f-4320-9b0e-9322a353e65b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:38:27.872097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db082c31-0d1f-4320-9b0e-9322a353e65b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:38:27.872346 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db082c31-0d1f-4320-9b0e-9322a353e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:38:27.911228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-db082c31-0d1f-4320-9b0e-9322a353e65b None None] MFA Rules not processed for user `7894de8aef044b739ee9bf69051951f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:38:27.913779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-db082c31-0d1f-4320-9b0e-9322a353e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:38:27.931226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1403/2800] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:38:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:38:37.900748 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:37.809770 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:39:37.811199 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:37.882879 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e8c74-d291-47ab-b846-8b8c2a8a5da9 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:39:37.888555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cc944-fe19-4a79-8968-094ab291c8d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:39:37.889765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc944-fe19-4a79-8968-094ab291c8d0 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:39:37.890098 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc944-fe19-4a79-8968-094ab291c8d0 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:39:37.890395 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cc944-fe19-4a79-8968-094ab291c8d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:39:37.892109 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-866cc944-fe19-4a79-8968-094ab291c8d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:39:37.905200 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cc944-fe19-4a79-8968-094ab291c8d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:39:37.906958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cc944-fe19-4a79-8968-094ab291c8d0 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:39:37.917103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1398/2801] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:39:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:39:47.912771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=32 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:04.464713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db082c31-0d1f-4320-9b0e-9322a353e65b None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:04.485183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db082c31-0d1f-4320-9b0e-9322a353e65b None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:04.494297 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:04.495325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:04.495803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:04.496452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:04.500207 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:04.523932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:04.527319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:04.547275 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1404/2802] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:40:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:40:14.539285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:22.976387 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd524-6f81-4a07-ba82-bb3162a9793a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:22.978100 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd524-6f81-4a07-ba82-bb3162a9793a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:22.978610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bd524-6f81-4a07-ba82-bb3162a9793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:23.013159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-eb0bd524-6f81-4a07-ba82-bb3162a9793a None None] MFA Rules not processed for user `7894de8aef044b739ee9bf69051951f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:40:23.015381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-eb0bd524-6f81-4a07-ba82-bb3162a9793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:23.023902 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1399/2803] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:40:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:40:23.423121 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:23.434735 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e673d-5ca7-4867-913a-5acf7870a6b2 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:23.439614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:23.440331 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:23.440662 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:23.441135 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:23.443244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:23.454710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:23.456199 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:23.468572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1405/2804] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:40:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:40:23.923891 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bd524-6f81-4a07-ba82-bb3162a9793a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:23.938749 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bd524-6f81-4a07-ba82-bb3162a9793a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:23.945869 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024b533-cafd-4572-81c7-76f88bddaa6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:23.946860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b533-cafd-4572-81c7-76f88bddaa6f service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:23.947136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b533-cafd-4572-81c7-76f88bddaa6f service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:23.947396 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024b533-cafd-4572-81c7-76f88bddaa6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:23.950952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3024b533-cafd-4572-81c7-76f88bddaa6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:23.965371 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024b533-cafd-4572-81c7-76f88bddaa6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:23.967169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024b533-cafd-4572-81c7-76f88bddaa6f service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:23.979332 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1400/2805] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:40:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:40:33.461561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:33.974159 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=9 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:34.317271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:40:34.319257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:34.335734 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134337e-187b-49e3-b8c4-a3fc414ebffd service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:40:34.342719 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc34b-62f5-4645-be93-5c2d7a213eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:40:34.343320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc34b-62f5-4645-be93-5c2d7a213eca service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:40:34.343619 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc34b-62f5-4645-be93-5c2d7a213eca service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:40:34.343881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc34b-62f5-4645-be93-5c2d7a213eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:40:34.345649 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f47bc34b-62f5-4645-be93-5c2d7a213eca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:40:34.358697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc34b-62f5-4645-be93-5c2d7a213eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:40:34.360287 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc34b-62f5-4645-be93-5c2d7a213eca service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:40:34.371655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1406/2806] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:40:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:40:44.366171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:14.599445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b035-e17b-4d8e-9d63-7582d22bd338 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:14.600172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b035-e17b-4d8e-9d63-7582d22bd338 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:14.600172 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895b035-e17b-4d8e-9d63-7582d22bd338 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:14.601518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1401/2807] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 10:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:41:14.607705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:14.608238 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:14.608345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:14.683215 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:14.684312 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:14.693066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1407/2808] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:14.709131 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895b035-e17b-4d8e-9d63-7582d22bd338 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:14.721735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895b035-e17b-4d8e-9d63-7582d22bd338 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:14.725846 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5355d7-4470-485b-a43d-79fa759d551e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:14.726612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5355d7-4470-485b-a43d-79fa759d551e service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:14.727221 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5355d7-4470-485b-a43d-79fa759d551e service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:14.727608 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5355d7-4470-485b-a43d-79fa759d551e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:14.736988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5355d7-4470-485b-a43d-79fa759d551e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:14.738850 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5355d7-4470-485b-a43d-79fa759d551e service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:14.749251 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1402/2809] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:41:14.929083 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:14.931150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:14.956443 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a949eaa-a878-47cd-917f-5f099c620bf7 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:14.962589 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13541cc6-4642-4038-9204-a9c6e7f9d980 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:14.963311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541cc6-4642-4038-9204-a9c6e7f9d980 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:14.963590 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541cc6-4642-4038-9204-a9c6e7f9d980 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:14.963858 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13541cc6-4642-4038-9204-a9c6e7f9d980 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:14.965680 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-13541cc6-4642-4038-9204-a9c6e7f9d980 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:14.978246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13541cc6-4642-4038-9204-a9c6e7f9d980 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:14.980427 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13541cc6-4642-4038-9204-a9c6e7f9d980 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:14.991803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1408/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:41:15.340823 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f47b-29a8-49f3-b4c7-0ea74f616ea6 None None] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:15.341138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f47b-29a8-49f3-b4c7-0ea74f616ea6 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:15.342023 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f47b-29a8-49f3-b4c7-0ea74f616ea6 None None] PATH_INFO: `/` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:15.343317 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1403/2811] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 10:41:15.349235 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc638-816a-47f0-b9e5-878fe5fe2fc2 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:15.349890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc638-816a-47f0-b9e5-878fe5fe2fc2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:15.349990 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acc638-816a-47f0-b9e5-878fe5fe2fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:15.393561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-c7acc638-816a-47f0-b9e5-878fe5fe2fc2 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:41:15.394823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c7acc638-816a-47f0-b9e5-878fe5fe2fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:41:15.405336 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1409/2812] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:41:15.417067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f47b-29a8-49f3-b4c7-0ea74f616ea6 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:41:15.429047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f47b-29a8-49f3-b4c7-0ea74f616ea6 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:41:15.433572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:41:15.434227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:41:15.434503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:41:15.434791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:41:15.446483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:41:15.448503 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:41:15.461237 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1404/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:41:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:41:25.390827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=28 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:25.455633 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=12 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:05.987061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc638-816a-47f0-b9e5-878fe5fe2fc2 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:42:05.998167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acc638-816a-47f0-b9e5-878fe5fe2fc2 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:42:06.004496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:42:06.005097 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:06.005371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:06.005637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:06.013904 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:42:06.015728 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:42:06.024989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1410/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:42:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:42:16.020727 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:21.905949 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:42:21.917658 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100ce7d-49dd-4506-a3d6-971a0e3e583e service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:42:21.923497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c7dd2-d98a-491b-ba5a-08ab789e5166 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:42:21.924115 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c7dd2-d98a-491b-ba5a-08ab789e5166 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:21.924419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c7dd2-d98a-491b-ba5a-08ab789e5166 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:21.924689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c7dd2-d98a-491b-ba5a-08ab789e5166 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:21.926524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-309c7dd2-d98a-491b-ba5a-08ab789e5166 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:42:21.940044 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c7dd2-d98a-491b-ba5a-08ab789e5166 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:42:21.941664 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c7dd2-d98a-491b-ba5a-08ab789e5166 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:42:21.952873 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1405/2815] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:42:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:42:27.843949 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:42:27.854051 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fa78-316c-46d6-8af0-00ccde974ddf service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:42:27.857852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:42:27.858454 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:27.858753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:27.859023 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:27.870246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:42:27.876309 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:42:27.882642 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1411/2816] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:42:31.089439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5253c3d-c93b-4709-b053-6f659cc72ce8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:31.089980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5253c3d-c93b-4709-b053-6f659cc72ce8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:31.089980 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5253c3d-c93b-4709-b053-6f659cc72ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:31.109508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-a5253c3d-c93b-4709-b053-6f659cc72ce8 None None] MFA Rules not processed for user `7894de8aef044b739ee9bf69051951f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:42:31.111304 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a5253c3d-c93b-4709-b053-6f659cc72ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:42:31.118374 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1406/2817] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:42:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:42:31.535241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:42:31.554944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184004d-9637-4c78-9c5e-578716a11f53 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:42:31.569964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:42:31.570610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:31.571043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:31.571681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:31.588814 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:42:31.590880 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:42:31.608531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1412/2818] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:42:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:42:41.104671 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=9 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:41.603093 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:42:47.693042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5253c3d-c93b-4709-b053-6f659cc72ce8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:42:47.709331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5253c3d-c93b-4709-b053-6f659cc72ce8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:42:47.715771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:42:47.716611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:42:47.716973 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:42:47.717574 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:42:47.720116 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:42:47.737011 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:42:47.738632 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:42:47.752997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1407/2819] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:42:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:42:57.745629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:22.744923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:43:22.785653 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26474d47-c008-4c84-8d30-e247c82330e2 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:43:22.789462 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:43:22.790047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:43:22.790313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:43:22.790575 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:43:22.822457 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:43:22.824122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:43:22.835941 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1413/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:43:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:43:24.027532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:43:24.047856 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb0028-f76f-4b87-a2d2-d4051073af13 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:43:24.051571 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:43:24.052170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:43:24.052445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:43:24.052740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:43:24.063461 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:43:24.064912 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:43:24.076032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1408/2821] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:43:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:43:32.830465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=27 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:34.071057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=11 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:35.343214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:43:35.354045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162c814-a7ef-486b-9a85-ebb606ca6767 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:43:35.358088 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f49307-f6e1-4d64-bb95-5e50f70e3a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:43:35.358710 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49307-f6e1-4d64-bb95-5e50f70e3a9e service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:43:35.358987 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49307-f6e1-4d64-bb95-5e50f70e3a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:43:35.359305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f49307-f6e1-4d64-bb95-5e50f70e3a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:43:35.367212 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f49307-f6e1-4d64-bb95-5e50f70e3a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:43:35.368663 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f49307-f6e1-4d64-bb95-5e50f70e3a9e service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:43:35.376681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1414/2822] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:43:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:43:45.373046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:18.098167 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:44:18.110984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5d90c-8c14-4cb6-8b14-825b20c60b1b service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:44:18.118919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:44:18.118919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:18.118919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:18.119381 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:18.122775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:18.167456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:44:18.169828 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:44:18.185700 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1409/2823] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:44:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:44:28.178379 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=10 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:28.253242 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bf2f-fe10-4e21-a88e-c1c31f4d3135 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:28.254145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bf2f-fe10-4e21-a88e-c1c31f4d3135 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:28.254421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bf2f-fe10-4e21-a88e-c1c31f4d3135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:28.289775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-18e5bf2f-fe10-4e21-a88e-c1c31f4d3135 None None] MFA Rules not processed for user `7894de8aef044b739ee9bf69051951f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:44:28.292145 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-18e5bf2f-fe10-4e21-a88e-c1c31f4d3135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:44:28.300881 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1415/2824] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:44:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:44:38.272184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:43.795351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:44:43.816863 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdfec-a725-46d4-9db9-8beb8f20ff51 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:44:43.822611 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:44:43.823235 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:44:43.823510 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:44:43.823775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:44:43.833161 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:44:43.834881 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:44:43.845751 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1410/2825] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:44:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:44:53.841418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=10 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:31.109426 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5bf2f-fe10-4e21-a88e-c1c31f4d3135 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:31.125019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5bf2f-fe10-4e21-a88e-c1c31f4d3135 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:31.130886 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b749774-4c3e-43cc-a3f2-fa47a1adf1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:31.131499 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749774-4c3e-43cc-a3f2-fa47a1adf1f6 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:31.131774 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749774-4c3e-43cc-a3f2-fa47a1adf1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:31.132042 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b749774-4c3e-43cc-a3f2-fa47a1adf1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:31.142136 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749774-4c3e-43cc-a3f2-fa47a1adf1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:31.143866 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b749774-4c3e-43cc-a3f2-fa47a1adf1f6 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:31.154516 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1416/2826] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:45:37.277349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:37.353591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2ea65-304d-4927-b01c-c2a4905c32c4 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:37.358556 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:37.366005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:37.366005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:37.366005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] PATH_INFO: `/v3/users/7894de8aef044b739ee9bf69051951f0` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:37.366005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7894de8aef044b739ee9bf69051951f0)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:37.366005 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:37.562428 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7894de8aef044b739ee9bf69051951f0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:37.660038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7894de8aef044b739ee9bf69051951f0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:37.686509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7894de8aef044b739ee9bf69051951f0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:37.687417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7894de8aef044b739ee9bf69051951f0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:37.696389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-1950f967-323a-4e11-9018-28756c743097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7894de8aef044b739ee9bf69051951f0'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:37.707057 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1411/2827] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:45:37 2022] DELETE /identity/v3/users/7894de8aef044b739ee9bf69051951f0 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:37.712555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b946e0-043f-4944-bdff-dd10b6c4f2a5 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:37.713134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b946e0-043f-4944-bdff-dd10b6c4f2a5 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:37.713134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b946e0-043f-4944-bdff-dd10b6c4f2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:37.735171 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-78b946e0-043f-4944-bdff-dd10b6c4f2a5 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:37.736596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-78b946e0-043f-4944-bdff-dd10b6c4f2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:37.803325 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1417/2828] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:45:37.814314 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:37.814788 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:37.815280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:37.853814 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:37.855146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:37.916963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1412/2829] 10.222.0.49 () {58 vars in 1061 bytes} [Fri Oct 28 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:37.923795 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b946e0-043f-4944-bdff-dd10b6c4f2a5 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:37.938862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b946e0-043f-4944-bdff-dd10b6c4f2a5 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:37.943660 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:37.944259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:37.944533 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:37.945004 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:37.963071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:37.964561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:37.975390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1418/2830] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:45:38.326015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:38.327955 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:38.349651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd73d4-78ee-4fc0-a6ce-ae04a500c00e None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:38.360566 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:38.361439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:38.361839 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:38.362220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] PATH_INFO: `/v3/projects/24e3e3be476740a381e69dd04b21c017` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:38.363718 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e3e3be476740a381e69dd04b21c017)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:38.365970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:38.379672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:38.475985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e3e3be476740a381e69dd04b21c017', 'request_id': 'req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:38.568581 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e3e3be476740a381e69dd04b21c017', 'request_id': 'req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:38.575612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e3e3be476740a381e69dd04b21c017', 'request_id': 'req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:38.592230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] The token cache is being invalidate because project 24e3e3be476740a381e69dd04b21c017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:45:38.592230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:38.592230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:38.592230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1413/2831] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:45:38 2022] DELETE /identity/v3/projects/24e3e3be476740a381e69dd04b21c017 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:38.595741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:38.605415 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cccf1-295d-458f-82aa-d6484a737911 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:38.685206 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:38.685957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:38.686221 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:38.686489 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] PATH_INFO: `/v3/users/6b62e3c6e9aa4228abd5ab01a58d1179` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:38.687762 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b62e3c6e9aa4228abd5ab01a58d1179)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:38.689723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:38.972673 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b62e3c6e9aa4228abd5ab01a58d1179'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.052050 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b62e3c6e9aa4228abd5ab01a58d1179'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.052687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b62e3c6e9aa4228abd5ab01a58d1179'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.061791 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b62e3c6e9aa4228abd5ab01a58d1179'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.073052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:39.076503 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-6bde0826-75e6-448a-a9d7-c0cf3baaf33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b62e3c6e9aa4228abd5ab01a58d1179'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.084294 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1419/2832] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:45:38 2022] DELETE /identity/v3/users/6b62e3c6e9aa4228abd5ab01a58d1179 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:39.547771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:39.549265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:39.564174 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7831-fffa-46e5-b7ff-ff86a6cf0104 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:39.639862 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:39.640505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:39.640813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:39.641123 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] PATH_INFO: `/v3/projects/21974acd2bfa4d1c97d7fa24a3afb8be` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:39.642283 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21974acd2bfa4d1c97d7fa24a3afb8be)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:39.644305 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:39.763409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21974acd2bfa4d1c97d7fa24a3afb8be', 'request_id': 'req-5af418b5-8a6d-405a-a9f6-d84eaeab830b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.871981 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21974acd2bfa4d1c97d7fa24a3afb8be', 'request_id': 'req-5af418b5-8a6d-405a-a9f6-d84eaeab830b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.879527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21974acd2bfa4d1c97d7fa24a3afb8be', 'request_id': 'req-5af418b5-8a6d-405a-a9f6-d84eaeab830b'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.892117 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] The token cache is being invalidate because project 21974acd2bfa4d1c97d7fa24a3afb8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:45:39.892476 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.893127 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5af418b5-8a6d-405a-a9f6-d84eaeab830b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:45:39.894619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1414/2833] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:45:39 2022] DELETE /identity/v3/projects/21974acd2bfa4d1c97d7fa24a3afb8be => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:39.900584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc634987-2c97-4993-9ceb-0095b798cce4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:39.900986 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc634987-2c97-4993-9ceb-0095b798cce4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:39.901397 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc634987-2c97-4993-9ceb-0095b798cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:39.922925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-fc634987-2c97-4993-9ceb-0095b798cce4 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:39.924133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fc634987-2c97-4993-9ceb-0095b798cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:39.990577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1420/2834] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:39.999786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01c89-72b3-4e9d-82cd-8741af24b02a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.000086 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01c89-72b3-4e9d-82cd-8741af24b02a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.000383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01c89-72b3-4e9d-82cd-8741af24b02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.021085 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-7de01c89-72b3-4e9d-82cd-8741af24b02a None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:40.022277 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-7de01c89-72b3-4e9d-82cd-8741af24b02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:40.030339 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1415/2835] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:40.034713 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc634987-2c97-4993-9ceb-0095b798cce4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:40.044562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc634987-2c97-4993-9ceb-0095b798cce4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:40.051243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:40.052370 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.052883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.053390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.055133 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88565) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:45:40.055698 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:40.058862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:40.073835 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1421/2836] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:45:40.079716 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01c89-72b3-4e9d-82cd-8741af24b02a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:40.094256 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01c89-72b3-4e9d-82cd-8741af24b02a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:40.101760 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:40.102370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.102650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.102956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.103642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:40.105551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:40.251458 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1416/2837] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:45:40 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:40.255922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:40.271975 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6851d2b-4fc2-44ba-85bf-53a3905797f3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:40.344502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:40.345105 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.345377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.345644 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.346289 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:40.348257 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:40.463248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1422/2838] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:45:40 2022] POST /identity/v3/users => generated 286 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:40.467726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:40.473298 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:40.479672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76903e-970d-4d96-9ce4-5320baa2da7e admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:40.484550 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:40.485160 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.485429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.485694 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.486325 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:40.487958 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:40.499355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1417/2839] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:40.504504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:40.515178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43851-7500-4714-ae80-53abb1847c2b admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:40.519982 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9f226-c0ff-41e1-bbf3-2e6029686c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:40.520618 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9f226-c0ff-41e1-bbf3-2e6029686c98 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.521260 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9f226-c0ff-41e1-bbf3-2e6029686c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.521532 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9f226-c0ff-41e1-bbf3-2e6029686c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.522162 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9f226-c0ff-41e1-bbf3-2e6029686c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:40.523844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9f226-c0ff-41e1-bbf3-2e6029686c98 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:40.539701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1423/2840] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:40.544604 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:40.556363 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89739952-da12-4002-879d-298a50bb6692 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:40.561008 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:40.561647 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.561922 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.562215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] PATH_INFO: `/v3/projects/0d8a2c62f64e4eb3bc020a76f8cc2770/users/7af458b883074e26a7db935aafd8a63e/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.581916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8a2c62f64e4eb3bc020a76f8cc2770, user_id=7af458b883074e26a7db935aafd8a63e, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:40.584691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:40.704234 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1418/2841] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:45:40 2022] PUT /identity/v3/projects/0d8a2c62f64e4eb3bc020a76f8cc2770/users/7af458b883074e26a7db935aafd8a63e/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:40.709761 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd52511-3985-46c8-a65f-d84b3222322b None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.710043 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd52511-3985-46c8-a65f-d84b3222322b None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.710315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd52511-3985-46c8-a65f-d84b3222322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.732259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-9cd52511-3985-46c8-a65f-d84b3222322b None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:40.733433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-9cd52511-3985-46c8-a65f-d84b3222322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:40.784006 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:40.792799 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1424/2842] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:45:40.802848 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:40.804620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:40.865763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272f85-9470-4783-a9f7-ea33554b539c admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:40.869407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:40.870087 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:40.870370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:40.870624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:40.880168 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:40.881662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:40.891267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1419/2843] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:46.671625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3762744-9647-4210-a370-8558d74def09 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:46.672197 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3762744-9647-4210-a370-8558d74def09 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:46.672311 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3762744-9647-4210-a370-8558d74def09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:46.706561 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e3762744-9647-4210-a370-8558d74def09 None None] MFA Rules not processed for user `7af458b883074e26a7db935aafd8a63e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:46.709305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e3762744-9647-4210-a370-8558d74def09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:46.787102 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1425/2844] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:46.792572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:46.803186 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d750-2efa-45a1-bc0d-d5dfe12687e6 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:46.808180 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:46.808797 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:46.809075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:46.809344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:46.809988 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:46.811977 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:46.907840 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1420/2845] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:45:46 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:46.912270 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3762744-9647-4210-a370-8558d74def09 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:46.927964 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3762744-9647-4210-a370-8558d74def09 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:47.029161 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:47.029786 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:47.030060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:47.030329 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:47.031029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:47.036377 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:47.192400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1426/2846] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:45:46 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:45:47.197315 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:47.209382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889caa1-10ce-4d7b-98ac-6492e5b86fa9 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:47.214804 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:47.215349 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:47.215624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:47.215914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:47.216551 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:47.218143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:47.230019 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1421/2847] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:47.234566 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:47.245502 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24062-3001-4fcf-84d0-26efd174bdb0 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:47.250844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:47.251509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:47.251782 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:47.252062 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] PATH_INFO: `/v3/projects/f965593ce8404ab8ad817de78f288918/users/11b9ab3736484a3fa62c9550ef5f1295/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:47.269587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f965593ce8404ab8ad817de78f288918, user_id=11b9ab3736484a3fa62c9550ef5f1295, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:47.272361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:47.358497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1427/2848] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:45:47 2022] PUT /identity/v3/projects/f965593ce8404ab8ad817de78f288918/users/11b9ab3736484a3fa62c9550ef5f1295/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:47.365022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:47.375067 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caef79-b121-4656-aece-06031fdf9538 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:47.437806 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2ebd1-aaf0-4e05-923c-b3ea78fc9603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:47.438448 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ebd1-aaf0-4e05-923c-b3ea78fc9603 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:47.438765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ebd1-aaf0-4e05-923c-b3ea78fc9603 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:47.439036 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2ebd1-aaf0-4e05-923c-b3ea78fc9603 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:47.439682 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2ebd1-aaf0-4e05-923c-b3ea78fc9603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:47.441351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2ebd1-aaf0-4e05-923c-b3ea78fc9603 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:47.453075 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1422/2849] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:45:47.457843 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:47.474110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976053-6b5a-4e21-96a9-e51342103934 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:47.481419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:47.482022 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:47.482298 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:47.482564 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] PATH_INFO: `/v3/projects/f965593ce8404ab8ad817de78f288918/users/11b9ab3736484a3fa62c9550ef5f1295/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:47.484624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f965593ce8404ab8ad817de78f288918, user_id=11b9ab3736484a3fa62c9550ef5f1295, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:47.487320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:47.499529 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1428/2850] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:45:47 2022] PUT /identity/v3/projects/f965593ce8404ab8ad817de78f288918/users/11b9ab3736484a3fa62c9550ef5f1295/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:45:53.827695 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9825-de1d-4785-ac82-3ae05af0e91f None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:53.829826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9825-de1d-4785-ac82-3ae05af0e91f None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:53.830280 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d9825-de1d-4785-ac82-3ae05af0e91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:53.869342 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-e34d9825-de1d-4785-ac82-3ae05af0e91f None None] MFA Rules not processed for user `11b9ab3736484a3fa62c9550ef5f1295`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:53.870907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e34d9825-de1d-4785-ac82-3ae05af0e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:53.895521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:53.983028 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1423/2851] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:45:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:53.998271 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:54.000190 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:54.059244 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:54.100029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c6058-4184-4d82-bd3a-577f33f2aa86 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:54.108624 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe04d70-612d-4260-8b80-9d376764e94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:54.109685 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe04d70-612d-4260-8b80-9d376764e94a service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:54.109981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe04d70-612d-4260-8b80-9d376764e94a service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:54.110252 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe04d70-612d-4260-8b80-9d376764e94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:54.176939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe04d70-612d-4260-8b80-9d376764e94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:54.178846 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe04d70-612d-4260-8b80-9d376764e94a service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:54.189061 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1429/2852] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:45:57.423527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:57.424181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:57.424181 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:57.445771 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] MFA Rules not processed for user `7af458b883074e26a7db935aafd8a63e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:57.447316 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:57.454816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1424/2853] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:45:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:58.272441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a6f2-0534-4510-a584-33e9334384f4 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:58.273717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a6f2-0534-4510-a584-33e9334384f4 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:58.273717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a6f2-0534-4510-a584-33e9334384f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:58.346557 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-eef2a6f2-0534-4510-a584-33e9334384f4 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:45:58.347870 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-eef2a6f2-0534-4510-a584-33e9334384f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:58.428655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1430/2854] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:45:58.442103 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:45:58.444020 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:45:58.460606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a1ff4-cbf1-4efd-818e-0f018eca5428 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:45:58.465674 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eceb1df-ee87-43f2-80fe-40e70aa815cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:45:58.466274 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb1df-ee87-43f2-80fe-40e70aa815cf service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:45:58.466763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb1df-ee87-43f2-80fe-40e70aa815cf service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:45:58.467027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eceb1df-ee87-43f2-80fe-40e70aa815cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:45:58.475860 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eceb1df-ee87-43f2-80fe-40e70aa815cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:45:58.477957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eceb1df-ee87-43f2-80fe-40e70aa815cf service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:45:58.488907 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1425/2855] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:08.419348 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=77 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:08.484582 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=28 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:09.965341 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a6f2-0534-4510-a584-33e9334384f4 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:09.980779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a6f2-0534-4510-a584-33e9334384f4 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:09.988903 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:09.989164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:09.989419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:09.989692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:09.991577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:10.006003 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:10.007701 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:10.020484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1431/2856] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:13.778079 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30aae-ee93-40ec-84d1-e0ff3a7f82d8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:13.778641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30aae-ee93-40ec-84d1-e0ff3a7f82d8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:13.778641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30aae-ee93-40ec-84d1-e0ff3a7f82d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:13.799777 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-beb30aae-ee93-40ec-84d1-e0ff3a7f82d8 None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:46:13.801069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-beb30aae-ee93-40ec-84d1-e0ff3a7f82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:46:13.868002 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1426/2857] 10.222.0.49 () {58 vars in 1061 bytes} [Fri Oct 28 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:46:13.875192 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:46:13.885850 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac397f85-505f-4741-845e-7dbe3e881b7e service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:46:13.890148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:46:13.890776 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:46:13.891052 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:46:13.891313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:46:13.901755 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:46:13.903305 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:46:13.915750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1432/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:46:23.861733 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=23 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:23.908852 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:22.806224 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb30aae-ee93-40ec-84d1-e0ff3a7f82d8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:22.814813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb30aae-ee93-40ec-84d1-e0ff3a7f82d8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:22.818521 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac68c7-e4e6-47ba-ba92-5d5f69fc7a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:22.819216 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac68c7-e4e6-47ba-ba92-5d5f69fc7a09 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:22.819541 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac68c7-e4e6-47ba-ba92-5d5f69fc7a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:22.819852 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac68c7-e4e6-47ba-ba92-5d5f69fc7a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:22.821895 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2dac68c7-e4e6-47ba-ba92-5d5f69fc7a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:22.880786 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac68c7-e4e6-47ba-ba92-5d5f69fc7a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:22.883543 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac68c7-e4e6-47ba-ba92-5d5f69fc7a09 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:22.919731 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1427/2859] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:24.111957 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:24.124150 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49295c-9a28-44dc-b1d4-5b3db8af37c5 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:24.128045 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270c40-2164-4f10-b872-b1361de0f1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:24.128664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270c40-2164-4f10-b872-b1361de0f1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:24.128939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270c40-2164-4f10-b872-b1361de0f1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:24.129211 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270c40-2164-4f10-b872-b1361de0f1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:24.131176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2f270c40-2164-4f10-b872-b1361de0f1b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:24.147587 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270c40-2164-4f10-b872-b1361de0f1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:24.149030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270c40-2164-4f10-b872-b1361de0f1b3 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:24.161278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1433/2860] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:48:25.976015 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2477-49b5-4122-a9e8-2df9178c13f7 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:25.976595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2477-49b5-4122-a9e8-2df9178c13f7 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:25.976595 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2477-49b5-4122-a9e8-2df9178c13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:26.060826 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-b15f2477-49b5-4122-a9e8-2df9178c13f7 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:26.062984 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b15f2477-49b5-4122-a9e8-2df9178c13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:26.138942 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1428/2861] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:26.293479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387e18-ee10-476a-8ea2-43c351c25337 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:26.294019 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387e18-ee10-476a-8ea2-43c351c25337 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:26.294143 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387e18-ee10-476a-8ea2-43c351c25337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:26.374878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-88387e18-ee10-476a-8ea2-43c351c25337 None None] MFA Rules not processed for user `23992d468c5c427f9cac898359ee569a`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:26.376122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-88387e18-ee10-476a-8ea2-43c351c25337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:26.469617 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1434/2862] 10.222.0.49 () {58 vars in 1040 bytes} [Fri Oct 28 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:26.487421 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2477-49b5-4122-a9e8-2df9178c13f7 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:26.502027 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2477-49b5-4122-a9e8-2df9178c13f7 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:26.508169 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:26.509201 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:26.509675 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:26.510435 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:26.526569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:26.529997 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:26.543389 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1429/2863] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:48:36.466073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=54 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:36.537356 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=64 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:38.481591 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387e18-ee10-476a-8ea2-43c351c25337 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:38.491054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387e18-ee10-476a-8ea2-43c351c25337 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:38.494771 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c2629-8ae5-400b-acab-3658b11c5bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:38.495402 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c2629-8ae5-400b-acab-3658b11c5bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:38.495678 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c2629-8ae5-400b-acab-3658b11c5bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:38.495945 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c2629-8ae5-400b-acab-3658b11c5bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:38.497822 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-959c2629-8ae5-400b-acab-3658b11c5bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:38.509035 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c2629-8ae5-400b-acab-3658b11c5bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:38.510486 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c2629-8ae5-400b-acab-3658b11c5bf3 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:38.520264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1435/2864] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:48:41.660296 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:41.670471 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628398c-ff18-44b5-947a-5d990e475de5 service swift] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:41.674104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8804c53-e51c-442b-abf1-b46b87e72c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:41.674725 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8804c53-e51c-442b-abf1-b46b87e72c4d service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:41.675001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8804c53-e51c-442b-abf1-b46b87e72c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:41.675269 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8804c53-e51c-442b-abf1-b46b87e72c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:41.677040 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c8804c53-e51c-442b-abf1-b46b87e72c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:41.687985 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8804c53-e51c-442b-abf1-b46b87e72c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:41.689650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8804c53-e51c-442b-abf1-b46b87e72c4d service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:41.698509 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1430/2865] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:42.216999 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268171-304b-4332-8e74-c99fe928543a None None] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:42.217584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268171-304b-4332-8e74-c99fe928543a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:42.217584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03268171-304b-4332-8e74-c99fe928543a None None] PATH_INFO: `/` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:42.219118 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1436/2866] 10.222.0.49 () {54 vars in 921 bytes} [Fri Oct 28 10:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 10:48:42.224306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddf590-b5d8-4192-9ff5-8e8764045333 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:42.224594 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddf590-b5d8-4192-9ff5-8e8764045333 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:42.224865 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddf590-b5d8-4192-9ff5-8e8764045333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:42.246638 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1cddf590-b5d8-4192-9ff5-8e8764045333 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:42.247901 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1cddf590-b5d8-4192-9ff5-8e8764045333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:42.262516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1431/2867] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:48:42.274636 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004136a2-3433-4850-95b0-df3bde9a5638 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:42.275130 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004136a2-3433-4850-95b0-df3bde9a5638 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:42.278837 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004136a2-3433-4850-95b0-df3bde9a5638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:42.343109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-004136a2-3433-4850-95b0-df3bde9a5638 None None] MFA Rules not processed for user `ff6aed7405ec4740b3c5971d24850ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:42.344355 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-004136a2-3433-4850-95b0-df3bde9a5638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:42.411699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1437/2868] 10.222.0.49 () {58 vars in 1059 bytes} [Fri Oct 28 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:42.417795 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddf590-b5d8-4192-9ff5-8e8764045333 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:42.428468 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddf590-b5d8-4192-9ff5-8e8764045333 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:42.431655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:42.432534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:42.432808 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:42.433119 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:42.448122 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:42.450452 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:42.463800 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1432/2869] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:42.715861 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004136a2-3433-4850-95b0-df3bde9a5638 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:42.726013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004136a2-3433-4850-95b0-df3bde9a5638 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:42.730176 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fcb1a-56fd-4648-ac67-ce7c4f8fbac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:42.730914 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcb1a-56fd-4648-ac67-ce7c4f8fbac5 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:42.731188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcb1a-56fd-4648-ac67-ce7c4f8fbac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:42.731451 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fcb1a-56fd-4648-ac67-ce7c4f8fbac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:42.733337 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f57fcb1a-56fd-4648-ac67-ce7c4f8fbac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:42.745374 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fcb1a-56fd-4648-ac67-ce7c4f8fbac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:42.747472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fcb1a-56fd-4648-ac67-ce7c4f8fbac5 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:42.757495 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1438/2870] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:48:42.845796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:42.856022 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add99aa-412e-4557-954e-845b19b99237 service glance] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:42.861772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:42.862383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:42.862659 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:42.862954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:42.864930 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:42.880223 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:42.881705 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:42.898069 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1433/2871] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:42.960316 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b774b-8ad0-4cbe-825e-a734492c419c None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:42.960625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b774b-8ad0-4cbe-825e-a734492c419c None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:42.960913 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b774b-8ad0-4cbe-825e-a734492c419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:42.985752 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-dd5b774b-8ad0-4cbe-825e-a734492c419c None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:42.987044 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-dd5b774b-8ad0-4cbe-825e-a734492c419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:42.997288 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1439/2872] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:43.012254 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:43.025311 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f41b1-55e0-425c-b361-b5889075ba84 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:43.032527 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:43.033175 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:43.033441 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:43.033916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:43.045409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:43.047104 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:43.058276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1434/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:48:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:48:45.700400 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ab0d-f6b7-4531-aa5d-033a35394fe2 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:45.701029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ab0d-f6b7-4531-aa5d-033a35394fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:45.701029 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483ab0d-f6b7-4531-aa5d-033a35394fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:45.720666 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-a483ab0d-f6b7-4531-aa5d-033a35394fe2 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:48:45.721864 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a483ab0d-f6b7-4531-aa5d-033a35394fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:48:45.729753 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1440/2874] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:48:45.742844 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:48:45.753894 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7092-8544-405e-a205-82c5a32f866a service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:48:45.760323 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:48:45.760975 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:48:45.761244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:48:45.761584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:48:45.772211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:48:45.773871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:48:45.783244 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1435/2875] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:48:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:48:55.715241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=56 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:55.779765 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=33 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:00.516430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:49:00.517066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:49:00.517066 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:49:00.539585 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:49:00.541477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:49:00.549127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1441/2876] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 10:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:49:00.562874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:49:00.578144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8734ddf-feeb-4c4d-b2aa-ea140af0a050 service swift] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:49:00.583641 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:49:00.584240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:49:00.584516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:49:00.584785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:49:00.596529 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:49:00.598114 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:49:00.606941 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1436/2877] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:49:10.532274 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:10.603545 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:49.816692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:49:49.818202 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:49:49.836285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9a27e-1445-4a6e-9af7-7c232707259d None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:49:49.841948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13165fe4-722a-4a92-8cde-f27aeedee764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:49:49.842558 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165fe4-722a-4a92-8cde-f27aeedee764 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:49:49.842860 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165fe4-722a-4a92-8cde-f27aeedee764 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:49:49.843127 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165fe4-722a-4a92-8cde-f27aeedee764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:49:49.844862 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-13165fe4-722a-4a92-8cde-f27aeedee764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:49:49.856747 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13165fe4-722a-4a92-8cde-f27aeedee764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:49:49.858319 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13165fe4-722a-4a92-8cde-f27aeedee764 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:49:49.868609 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1442/2878] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:49:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:49:59.864167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:15.349508 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:15.351847 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:15.372402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1776b-9cd6-4fbd-91c3-1c29401060ae service swift] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:15.378470 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:15.379238 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:15.379579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:15.379916 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:15.381903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:15.395792 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:15.397505 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:15.409639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1437/2879] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:50:23.265478 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63ca0-2634-486c-aff4-d232e3376929 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:23.266046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63ca0-2634-486c-aff4-d232e3376929 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:23.266046 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce63ca0-2634-486c-aff4-d232e3376929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:23.285645 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-5ce63ca0-2634-486c-aff4-d232e3376929 None None] MFA Rules not processed for user `7af458b883074e26a7db935aafd8a63e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:50:23.286805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-5ce63ca0-2634-486c-aff4-d232e3376929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:23.293897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1443/2880] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:50:25.404183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:33.280442 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:45.536726 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:45.545874 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472065b-d604-4659-a34a-af6975a1edf3 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:45.549610 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17e83-1a47-4661-aa20-a495906f5f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:45.550205 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17e83-1a47-4661-aa20-a495906f5f7d service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:45.550475 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17e83-1a47-4661-aa20-a495906f5f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:45.550764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17e83-1a47-4661-aa20-a495906f5f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:45.552455 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-b1f17e83-1a47-4661-aa20-a495906f5f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:45.562704 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17e83-1a47-4661-aa20-a495906f5f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:45.564173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17e83-1a47-4661-aa20-a495906f5f7d service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:45.572542 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1438/2881] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:50:50.365214 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63ca0-2634-486c-aff4-d232e3376929 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:50.383436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce63ca0-2634-486c-aff4-d232e3376929 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:50.391283 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:50.392013 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:50.393167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:50.393167 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:50.394765 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:50.410412 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:50.412295 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:50.426722 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1444/2882] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:50:54.269829 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e18d-3ef5-476e-9fc3-663bcdf53389 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:54.270310 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e18d-3ef5-476e-9fc3-663bcdf53389 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:54.270426 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e18d-3ef5-476e-9fc3-663bcdf53389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:54.333042 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-1f26e18d-3ef5-476e-9fc3-663bcdf53389 None None] MFA Rules not processed for user `6b18f309b5cb4641997b637f8f17ac87`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:50:54.334569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1f26e18d-3ef5-476e-9fc3-663bcdf53389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:50:54.414394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1439/2883] 10.222.0.49 () {58 vars in 1054 bytes} [Fri Oct 28 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:50:54.422359 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:50:54.436572 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccc3fe-62f4-4d84-96c9-ff297a0e2815 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:50:54.442356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b18f309b5cb4641997b637f8f17ac87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:50:54.447937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:50:54.447937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:50:54.447937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:50:54.459328 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:50:54.460923 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:50:54.471408 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1445/2884] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:50:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:51:04.407045 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=44 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:04.465947 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=12 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:51.826439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a253d-92d6-4ab2-a88b-493a9bf21154 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:51.827112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a253d-92d6-4ab2-a88b-493a9bf21154 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:51.827112 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a253d-92d6-4ab2-a88b-493a9bf21154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:51.859494 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-2f8a253d-92d6-4ab2-a88b-493a9bf21154 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:51:51.860672 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-2f8a253d-92d6-4ab2-a88b-493a9bf21154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:51:51.869506 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1440/2885] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Oct 28 10:51:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:51:51.888944 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:51:51.901469 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e064d7-f73b-4ac5-a429-787933ac9489 service cinder] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:51:51.909750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf03ec8-39b0-453e-b92c-c7c65a76e41b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:51:51.909750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf03ec8-39b0-453e-b92c-c7c65a76e41b service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:51:51.909750 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf03ec8-39b0-453e-b92c-c7c65a76e41b service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:51:51.910132 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf03ec8-39b0-453e-b92c-c7c65a76e41b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:51:51.918788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf03ec8-39b0-453e-b92c-c7c65a76e41b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:51:51.920419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf03ec8-39b0-453e-b92c-c7c65a76e41b service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:51:51.930069 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1446/2886] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:51:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:52:01.854404 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=7 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:01.926060 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:39.086655 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eae7e-cc1b-425b-94e7-44a3d44e3f9b None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:39.087327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eae7e-cc1b-425b-94e7-44a3d44e3f9b None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:39.087327 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168eae7e-cc1b-425b-94e7-44a3d44e3f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:39.127919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-168eae7e-cc1b-425b-94e7-44a3d44e3f9b None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:53:39.129126 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-168eae7e-cc1b-425b-94e7-44a3d44e3f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:39.182915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1441/2887] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:53:39.189388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f3ed-2b60-49ba-8366-ee1c8658a4a8 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:39.193883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f3ed-2b60-49ba-8366-ee1c8658a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:39.193883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14f3ed-2b60-49ba-8366-ee1c8658a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:39.210876 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-6d14f3ed-2b60-49ba-8366-ee1c8658a4a8 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:53:39.212228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-6d14f3ed-2b60-49ba-8366-ee1c8658a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:39.222383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1447/2888] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:53:39.234642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eae7e-cc1b-425b-94e7-44a3d44e3f9b None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:39.255370 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168eae7e-cc1b-425b-94e7-44a3d44e3f9b None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:39.258966 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e15bb-cf6c-4d02-a52b-971051ec68ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:39.259558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e15bb-cf6c-4d02-a52b-971051ec68ba service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:39.259833 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e15bb-cf6c-4d02-a52b-971051ec68ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:39.260220 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e15bb-cf6c-4d02-a52b-971051ec68ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:39.270909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e15bb-cf6c-4d02-a52b-971051ec68ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:39.272360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e15bb-cf6c-4d02-a52b-971051ec68ba service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:39.283883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1442/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:40.476832 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53592e4-5cb4-4b89-a81e-233b697fc392 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:40.477407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53592e4-5cb4-4b89-a81e-233b697fc392 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:40.477407 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53592e4-5cb4-4b89-a81e-233b697fc392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:40.498112 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-d53592e4-5cb4-4b89-a81e-233b697fc392 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:53:40.499347 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-d53592e4-5cb4-4b89-a81e-233b697fc392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:40.509269 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1448/2890] 10.222.0.49 () {58 vars in 1057 bytes} [Fri Oct 28 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:53:40.516453 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f9e5-c569-4258-a57c-f4ded699d3fa None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:40.517047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f9e5-c569-4258-a57c-f4ded699d3fa None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:40.517483 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f9e5-c569-4258-a57c-f4ded699d3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:40.551380 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-c0e9f9e5-c569-4258-a57c-f4ded699d3fa None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:53:40.552591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c0e9f9e5-c569-4258-a57c-f4ded699d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:40.563406 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1443/2891] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:53:40.574437 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53592e4-5cb4-4b89-a81e-233b697fc392 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:40.584070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53592e4-5cb4-4b89-a81e-233b697fc392 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:40.588012 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:40.588607 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:40.588883 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:40.589152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:40.601152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:40.602573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:40.616575 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1449/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:49.387164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7b58-a0d7-42bf-941f-fd5172e02112 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:49.387838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7b58-a0d7-42bf-941f-fd5172e02112 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:49.387838 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7b58-a0d7-42bf-941f-fd5172e02112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:49.426230 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-f7fb7b58-a0d7-42bf-941f-fd5172e02112 None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:53:49.427456 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-f7fb7b58-a0d7-42bf-941f-fd5172e02112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:49.434179 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1444/2893] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Oct 28 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:53:49.449729 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:49.458120 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701097d-377f-42e8-a88e-90c84ccd2840 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:49.462008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:49.462610 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:49.462920 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:49.463186 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:49.471096 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:49.472523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:49.480513 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1450/2894] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:55.572211 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb7b58-a0d7-42bf-941f-fd5172e02112 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:55.581809 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb7b58-a0d7-42bf-941f-fd5172e02112 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:55.585575 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ade125-fa71-442d-88c1-357bb28dc940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:55.586382 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ade125-fa71-442d-88c1-357bb28dc940 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:55.586656 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ade125-fa71-442d-88c1-357bb28dc940 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:55.586952 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ade125-fa71-442d-88c1-357bb28dc940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:55.598612 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ade125-fa71-442d-88c1-357bb28dc940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:55.600141 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ade125-fa71-442d-88c1-357bb28dc940 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:55.608146 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1445/2895] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:55.692439 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:55.702008 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d73e7-f607-48b4-9468-a3af3051fd33 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:55.705643 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:55.706228 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:55.706514 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:55.706826 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:55.717712 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:55.719180 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:55.730823 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1451/2896] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:55.793407 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bcc02-3c5c-4e4b-8395-edb594b74145 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:55.793691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bcc02-3c5c-4e4b-8395-edb594b74145 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:55.793957 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bcc02-3c5c-4e4b-8395-edb594b74145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:55.814557 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-127bcc02-3c5c-4e4b-8395-edb594b74145 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:53:55.815796 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-127bcc02-3c5c-4e4b-8395-edb594b74145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:55.826697 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1446/2897] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Oct 28 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:53:55.833579 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:55.845323 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25969f-506a-44fe-a47f-8bc16fd1a8b9 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:55.850468 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:55.851158 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:55.851497 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:55.851831 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:55.860569 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:55.862267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:55.873246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1452/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:53:55.908724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884224-5970-4b04-9a2e-ccc2175e778a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:55.908724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884224-5970-4b04-9a2e-ccc2175e778a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:55.909065 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd884224-5970-4b04-9a2e-ccc2175e778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:55.937518 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-fd884224-5970-4b04-9a2e-ccc2175e778a None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:53:55.937653 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fd884224-5970-4b04-9a2e-ccc2175e778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:53:55.948272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1447/2899] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:53:55.965452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:53:55.987264 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4321bf-047c-4d76-8dba-2ead234a52b0 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:53:55.993812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a839542-a5ae-4f92-afd2-88a9a51b417b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:53:55.994419 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839542-a5ae-4f92-afd2-88a9a51b417b service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:53:55.994715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839542-a5ae-4f92-afd2-88a9a51b417b service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:53:55.994989 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839542-a5ae-4f92-afd2-88a9a51b417b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:53:56.005430 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a839542-a5ae-4f92-afd2-88a9a51b417b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:53:56.007075 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a839542-a5ae-4f92-afd2-88a9a51b417b service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:53:56.018226 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1453/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:54:05.926358 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=61 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:06.013690 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=36 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:05.283107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884224-5970-4b04-9a2e-ccc2175e778a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:05.292193 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd884224-5970-4b04-9a2e-ccc2175e778a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:05.295669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:05.296252 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:05.296558 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:05.296816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:05.298580 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:05.387068 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:05.388511 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:05.407963 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1448/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:06.347164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59e5d-55e5-4d28-a89f-010ab1f27574 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:06.355779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59e5d-55e5-4d28-a89f-010ab1f27574 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:06.355779 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59e5d-55e5-4d28-a89f-010ab1f27574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:06.370912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-83b59e5d-55e5-4d28-a89f-010ab1f27574 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:06.372110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-83b59e5d-55e5-4d28-a89f-010ab1f27574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:06.452246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1454/2902] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:06.470750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:06.480442 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd2410-ee17-43e8-9b05-cc61bf354142 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:06.485739 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:06.486351 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:06.486620 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:06.486915 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:06.497735 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:06.499350 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:06.510951 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1449/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:56:09.251845 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:09.252353 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:09.252463 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:09.273009 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] MFA Rules not processed for user `47f38d07f1c44175af29a9dfe93f0f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:09.274204 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:09.283342 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1455/2904] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:09.296253 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:09.309059 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed956a-b665-4c4e-a0b4-fdc5972baf4e service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:09.314616 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc35d8-8c56-456f-acb0-9c0f95af9f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:09.315318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc35d8-8c56-456f-acb0-9c0f95af9f6a service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:09.315606 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc35d8-8c56-456f-acb0-9c0f95af9f6a service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:09.315870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc35d8-8c56-456f-acb0-9c0f95af9f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:09.326451 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc35d8-8c56-456f-acb0-9c0f95af9f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:09.328265 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc35d8-8c56-456f-acb0-9c0f95af9f6a service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:09.339669 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1450/2905] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:16.224703 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:16.226233 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:16.298803 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b316-1595-48e1-b6c6-25389654a314 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:16.302371 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:16.303025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:16.303303 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:16.303573 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:16.305387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:16.397666 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:16.404267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:16.412410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=100 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:16.421672 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1456/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:19.334909 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=57 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:20.463338 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae38aa4-c555-4196-a7f9-fcfc5cfe1ac3 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:20.468017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae38aa4-c555-4196-a7f9-fcfc5cfe1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:20.468017 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae38aa4-c555-4196-a7f9-fcfc5cfe1ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:20.542427 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-fae38aa4-c555-4196-a7f9-fcfc5cfe1ac3 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:20.544876 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fae38aa4-c555-4196-a7f9-fcfc5cfe1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:20.632418 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1451/2907] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:20.644932 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:20.656381 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204319f8-fbc8-4f2a-8fae-c455edbf7715 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:20.663581 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:20.664391 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:20.664717 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:20.665041 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:20.681001 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:20.684203 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:20.701333 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1457/2908] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:24.921497 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:24.921967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:24.921967 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:24.942591 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:24.943812 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:24.952741 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1452/2909] 10.222.0.49 () {58 vars in 1018 bytes} [Fri Oct 28 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:24.967664 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:24.978219 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224515c3-55d9-4029-98f8-f96fa4187309 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:24.983291 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:24.983878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:24.984151 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:24.984441 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:24.993534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:24.995148 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:25.005243 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1458/2910] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:25.050163 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:25.051772 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:25.065135 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95829a68-3940-49f3-8616-f6b7ae664515 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:25.069763 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:25.070642 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:25.070953 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:25.071240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] PATH_INFO: `/v3/users/7af458b883074e26a7db935aafd8a63e` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:25.072354 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af458b883074e26a7db935aafd8a63e)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:25.074276 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:25.221787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af458b883074e26a7db935aafd8a63e'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.288287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af458b883074e26a7db935aafd8a63e'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.304910 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af458b883074e26a7db935aafd8a63e'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.305673 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af458b883074e26a7db935aafd8a63e'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.314212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af458b883074e26a7db935aafd8a63e'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.321195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1453/2911] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:56:25 2022] DELETE /identity/v3/users/7af458b883074e26a7db935aafd8a63e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:56:25.598770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:25.609978 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ff04b-4990-4d3c-a257-f3b9ad913da5 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:25.672345 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:25.672969 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:25.673241 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:25.673508 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] PATH_INFO: `/v3/projects/0d8a2c62f64e4eb3bc020a76f8cc2770` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:25.674625 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8a2c62f64e4eb3bc020a76f8cc2770)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:25.676633 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:25.792268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8a2c62f64e4eb3bc020a76f8cc2770', 'request_id': 'req-2824eb19-387c-475d-ab67-cb2a3dffced4'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.871200 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8a2c62f64e4eb3bc020a76f8cc2770', 'request_id': 'req-2824eb19-387c-475d-ab67-cb2a3dffced4'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.877948 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8a2c62f64e4eb3bc020a76f8cc2770', 'request_id': 'req-2824eb19-387c-475d-ab67-cb2a3dffced4'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.889939 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] The token cache is being invalidate because project 0d8a2c62f64e4eb3bc020a76f8cc2770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:56:25.890224 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.890908 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:25.892383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1459/2912] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:56:25 2022] DELETE /identity/v3/projects/0d8a2c62f64e4eb3bc020a76f8cc2770 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:56:25.897240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:25.898639 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:25.911919 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f770d5-5b42-49a4-a45f-a5cca77aa31f admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:25.942190 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:25.975394 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:25.976029 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:25.976303 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:25.976585 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] PATH_INFO: `/v3/users/11b9ab3736484a3fa62c9550ef5f1295` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:25.992460 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b9ab3736484a3fa62c9550ef5f1295)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:25.994619 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:26.189693 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b9ab3736484a3fa62c9550ef5f1295'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.282102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b9ab3736484a3fa62c9550ef5f1295'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.295512 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b9ab3736484a3fa62c9550ef5f1295'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.296240 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b9ab3736484a3fa62c9550ef5f1295'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.304032 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-6720ce7f-684d-4bdd-bf61-f6a223b2ce48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b9ab3736484a3fa62c9550ef5f1295'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.309896 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1454/2913] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 10:56:25 2022] DELETE /identity/v3/users/11b9ab3736484a3fa62c9550ef5f1295 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 10:56:26.546878 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:26.550605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:26.561627 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824eb19-387c-475d-ab67-cb2a3dffced4 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:26.622841 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:26.623472 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:26.623746 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:26.624011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] PATH_INFO: `/v3/projects/f965593ce8404ab8ad817de78f288918` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:26.625937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:26.635704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f965593ce8404ab8ad817de78f288918)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:26.637545 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:26.735471 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f965593ce8404ab8ad817de78f288918', 'request_id': 'req-208d0067-933d-4771-bf7b-a79b9ec39b97'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.836962 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f965593ce8404ab8ad817de78f288918', 'request_id': 'req-208d0067-933d-4771-bf7b-a79b9ec39b97'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.843026 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f965593ce8404ab8ad817de78f288918', 'request_id': 'req-208d0067-933d-4771-bf7b-a79b9ec39b97'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.855134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] The token cache is being invalidate because project f965593ce8404ab8ad817de78f288918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88565) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 10:56:26.858126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.858126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-208d0067-933d-4771-bf7b-a79b9ec39b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 10:56:26.858126 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1460/2914] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 10:56:26 2022] DELETE /identity/v3/projects/f965593ce8404ab8ad817de78f288918 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:56:26.863132 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc8afe-cc49-4bf3-bc33-444fe69592ed None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:26.863417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc8afe-cc49-4bf3-bc33-444fe69592ed None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:26.863699 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc8afe-cc49-4bf3-bc33-444fe69592ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:26.911145 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-0ebc8afe-cc49-4bf3-bc33-444fe69592ed None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:26.912335 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-0ebc8afe-cc49-4bf3-bc33-444fe69592ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:26.969615 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1455/2915] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:26.978418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeba0f-86fb-4fdf-8481-3d1f12c52b48 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:26.978800 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeba0f-86fb-4fdf-8481-3d1f12c52b48 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:26.979071 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debeba0f-86fb-4fdf-8481-3d1f12c52b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:26.998164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-debeba0f-86fb-4fdf-8481-3d1f12c52b48 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:26.999444 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-debeba0f-86fb-4fdf-8481-3d1f12c52b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:27.007450 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1461/2916] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:27.015618 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc8afe-cc49-4bf3-bc33-444fe69592ed None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:27.025743 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc8afe-cc49-4bf3-bc33-444fe69592ed None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:27.030624 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:27.031561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.031561 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.031813 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] PATH_INFO: `/v3/domains` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.032388 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 10:56:27.032662 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:27.034937 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:27.046634 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1456/2917] 10.222.0.49 () {58 vars in 1153 bytes} [Fri Oct 28 10:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 10:56:27.051699 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeba0f-86fb-4fdf-8481-3d1f12c52b48 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:27.062266 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debeba0f-86fb-4fdf-8481-3d1f12c52b48 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:27.074191 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:27.074851 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.075124 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.075390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.076474 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:27.078055 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:27.152278 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1462/2918] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:56:27 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:56:27.157355 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:27.163297 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:27.168683 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468677-b26f-4841-aa09-291fb7cf454c admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:27.229970 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:27.230572 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.230875 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.231143 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.231778 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:27.233689 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:27.317207 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1457/2919] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:56:27 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:56:27.321704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:27.332054 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265338e-31d6-441e-9586-43d210443554 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:27.336675 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:27.337267 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.337540 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.337805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.338445 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:27.340091 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:27.350996 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1463/2920] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:56:27.355191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:27.365677 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fc7f5-1b4b-4304-b837-2ef5c04b9ec5 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:27.370176 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7ab31-4f0e-4094-9661-9c0ecad51041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:27.372423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ab31-4f0e-4094-9661-9c0ecad51041 admin admin] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.372423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ab31-4f0e-4094-9661-9c0ecad51041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.372423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7ab31-4f0e-4094-9661-9c0ecad51041 admin admin] PATH_INFO: `/v3/roles` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.372423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7ab31-4f0e-4094-9661-9c0ecad51041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:27.373516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7ab31-4f0e-4094-9661-9c0ecad51041 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:27.383927 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1458/2921] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:56:27.388555 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:27.398844 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561a5f0-d835-4f21-a951-aa9b1d353d07 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:27.403517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:27.404094 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] REQUEST_METHOD: `PUT` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.404367 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.404634 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] PATH_INFO: `/v3/projects/77ccbcc7981f482d893fefbb3bbd899c/users/db12327676224f3c994b28b761efadb8/roles/41c7907fa20b41d3a299d45128434e86` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.419715 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ccbcc7981f482d893fefbb3bbd899c, user_id=db12327676224f3c994b28b761efadb8, role_id=41c7907fa20b41d3a299d45128434e86)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:27.422340 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:27.482605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1464/2922] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:56:27 2022] PUT /identity/v3/projects/77ccbcc7981f482d893fefbb3bbd899c/users/db12327676224f3c994b28b761efadb8/roles/41c7907fa20b41d3a299d45128434e86 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:56:27.493393 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7cde7-ff8f-4a29-9e2e-5d96a1031691 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.493677 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7cde7-ff8f-4a29-9e2e-5d96a1031691 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.493954 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7cde7-ff8f-4a29-9e2e-5d96a1031691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.512939 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-c4d7cde7-ff8f-4a29-9e2e-5d96a1031691 None None] MFA Rules not processed for user `6fcd63f0bb4e43ce8c0c41898fafca96`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:27.514128 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c4d7cde7-ff8f-4a29-9e2e-5d96a1031691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:27.573540 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1459/2923] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:27.583583 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:27.585360 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:27.642506 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87ecd-6a76-4dd2-88da-3ca4e6f19846 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:27.646534 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:27.647165 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:27.647459 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:27.647697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:27.657258 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:27.658596 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:27.669178 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1465/2924] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:32.948546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de974d0-7af6-46fb-9926-c4a19928a0e8 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:32.949074 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de974d0-7af6-46fb-9926-c4a19928a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:32.949563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de974d0-7af6-46fb-9926-c4a19928a0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:32.983914 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-9de974d0-7af6-46fb-9926-c4a19928a0e8 None None] MFA Rules not processed for user `db12327676224f3c994b28b761efadb8`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:32.985226 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-9de974d0-7af6-46fb-9926-c4a19928a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:33.068947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1460/2925] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:56:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:33.073854 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:33.084992 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce1655-0b58-4d90-bdb0-03b73e3bb303 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:33.090696 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:33.091313 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:33.091584 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:33.091847 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:33.092543 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:33.094620 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:33.106198 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:33.205971 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1466/2926] 10.222.0.49 () {60 vars in 1153 bytes} [Fri Oct 28 10:56:33 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 10:56:33.210745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de974d0-7af6-46fb-9926-c4a19928a0e8 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:33.223111 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de974d0-7af6-46fb-9926-c4a19928a0e8 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:33.231164 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:33.284081 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:33.284724 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:33.284999 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:33.285258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] PATH_INFO: `/v3/users` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:33.285911 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:33.287880 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:33.408815 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1461/2927] 10.222.0.49 () {60 vars in 1144 bytes} [Fri Oct 28 10:56:33 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 10:56:33.414396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:33.425757 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91ebc0-b5af-4576-839a-792e6fe6ae80 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:33.432389 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:33.433007 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:33.434897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:33.434897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:33.434897 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:33.435812 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:33.450496 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1467/2928] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:56:33.451708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:33.463754 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593e62e-05ba-493b-a03d-2455f3fee995 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:33.469667 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:33.470204 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:33.470484 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:33.470790 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] PATH_INFO: `/v3/projects/d27451c5d12d4b698be6e4aba33b9ab4/users/8a46a1c13f71473a93b5596c95024519/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:33.493245 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27451c5d12d4b698be6e4aba33b9ab4, user_id=8a46a1c13f71473a93b5596c95024519, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:33.498041 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:33.603859 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1462/2929] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:56:33 2022] PUT /identity/v3/projects/d27451c5d12d4b698be6e4aba33b9ab4/users/8a46a1c13f71473a93b5596c95024519/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:56:33.607950 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:33.619182 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1f226-da1a-4142-85ed-c14c90aa8fdb admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:33.679666 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7d973-b748-4070-9466-79032900e056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:33.680290 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7d973-b748-4070-9466-79032900e056 admin admin] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:33.687889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7d973-b748-4070-9466-79032900e056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:33.687889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7d973-b748-4070-9466-79032900e056 admin admin] PATH_INFO: `/v3/roles` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:33.687889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7d973-b748-4070-9466-79032900e056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:33.687889 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7d973-b748-4070-9466-79032900e056 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:33.694387 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1468/2930] 10.222.0.49 () {58 vars in 1122 bytes} [Fri Oct 28 10:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 10:56:33.699157 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:33.711073 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ebd81-a2da-4d8f-a99b-c0989995c447 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:33.716170 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:33.716851 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] REQUEST_METHOD: `PUT` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:33.717129 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:33.717403 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] PATH_INFO: `/v3/projects/d27451c5d12d4b698be6e4aba33b9ab4/users/8a46a1c13f71473a93b5596c95024519/roles/48ce22383ee4418c8b558995fcc19d90` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:33.719569 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27451c5d12d4b698be6e4aba33b9ab4, user_id=8a46a1c13f71473a93b5596c95024519, role_id=48ce22383ee4418c8b558995fcc19d90)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:33.722402 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:33.733918 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1463/2931] 10.222.0.49 () {60 vars in 1483 bytes} [Fri Oct 28 10:56:33 2022] PUT /identity/v3/projects/d27451c5d12d4b698be6e4aba33b9ab4/users/8a46a1c13f71473a93b5596c95024519/roles/48ce22383ee4418c8b558995fcc19d90 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 10:56:39.107874 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1916-02e8-42aa-8121-215ef9fc9d0a None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:39.108410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1916-02e8-42aa-8121-215ef9fc9d0a None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:39.108410 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1916-02e8-42aa-8121-215ef9fc9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:39.137320 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-af0e1916-02e8-42aa-8121-215ef9fc9d0a None None] MFA Rules not processed for user `8a46a1c13f71473a93b5596c95024519`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:39.138525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-af0e1916-02e8-42aa-8121-215ef9fc9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:39.210223 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1469/2932] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:56:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 10:56:39.227785 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:39.229685 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:39.340517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe7cd-b52e-4c58-a6df-8963f484d460 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:39.346445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914616b-8748-4a9f-a5be-49596efa32aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:39.347138 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914616b-8748-4a9f-a5be-49596efa32aa service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:39.347412 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914616b-8748-4a9f-a5be-49596efa32aa service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:39.347679 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914616b-8748-4a9f-a5be-49596efa32aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:39.409864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914616b-8748-4a9f-a5be-49596efa32aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:39.411715 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914616b-8748-4a9f-a5be-49596efa32aa service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:39.416802 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:39.421555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1464/2933] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:42.902356 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f019c6-dedd-4190-869c-2da9aa81d378 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:42.902958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f019c6-dedd-4190-869c-2da9aa81d378 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:42.902958 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f019c6-dedd-4190-869c-2da9aa81d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:42.922433 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-64f019c6-dedd-4190-869c-2da9aa81d378 None None] MFA Rules not processed for user `db12327676224f3c994b28b761efadb8`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:42.923665 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-64f019c6-dedd-4190-869c-2da9aa81d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:42.930482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1470/2934] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:43.255864 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:43.256439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:43.256439 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:43.276746 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] MFA Rules not processed for user `c6623b72a17b4f4493e675a344251f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:56:43.277994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:43.333063 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1465/2935] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:56:43.344912 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f019c6-dedd-4190-869c-2da9aa81d378 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:43.354819 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f019c6-dedd-4190-869c-2da9aa81d378 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:43.358418 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:43.359087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:43.359577 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:43.359849 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:43.368047 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:43.369477 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:43.377368 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1471/2936] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:45.825932 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:45.827409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:45.897698 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17fe0e-b9ea-42c6-852f-a223f1270e20 None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:45.903502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:45.903502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:45.903502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:45.903502 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:45.906657 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:45.918956 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:45.920583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:45.930534 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1466/2937] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:56:53.373893 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:55.926419 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=55 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:58.810338 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:56:58.823109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c3f54-043d-472f-9899-b38e8d45f057 service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:56:58.828723 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:56:58.829383 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:56:58.829656 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:56:58.829922 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:56:58.831760 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:56:58.844484 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:56:58.846248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:56:58.868838 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1472/2938] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:56:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:01.365263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:57:01.374824 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a12aa-e036-41e3-b9cc-24bb965b5858 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:57:01.378524 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:57:01.379215 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:57:01.379520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:57:01.379791 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:57:01.389457 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:57:01.390990 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:57:01.403006 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1467/2939] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:57:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:57:08.854605 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:11.397871 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=6 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:00.766138 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:59:00.767523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:00.859704 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c796d-81c0-4454-9d92-e3810a58adcb service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:59:00.864184 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecb7bc-c47a-4980-a724-7b8d3d594d1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff6aed7405ec4740b3c5971d24850ea6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:59:00.864790 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecb7bc-c47a-4980-a724-7b8d3d594d1b service glance] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:00.865068 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecb7bc-c47a-4980-a724-7b8d3d594d1b service glance] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:00.865520 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecb7bc-c47a-4980-a724-7b8d3d594d1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:00.867396 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-a6ecb7bc-c47a-4980-a724-7b8d3d594d1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:00.902638 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecb7bc-c47a-4980-a724-7b8d3d594d1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:59:00.904087 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecb7bc-c47a-4980-a724-7b8d3d594d1b service glance] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:59:00.925113 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1473/2940] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:59:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:59:03.500935 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:59:03.502447 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:03.516516 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0388c8-b93c-4872-80fd-d13eb22be303 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:59:03.520947 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:59:03.521555 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:03.521836 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:03.522107 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:03.523974 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:03.534740 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:59:03.536287 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:59:03.546328 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1468/2941] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:59:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:59:06.115142 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fed03-9ea8-4c1f-9f93-1adae16fbf65 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:06.116164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fed03-9ea8-4c1f-9f93-1adae16fbf65 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:06.116380 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5fed03-9ea8-4c1f-9f93-1adae16fbf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:06.169276 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-ba5fed03-9ea8-4c1f-9f93-1adae16fbf65 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:59:06.170482 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-ba5fed03-9ea8-4c1f-9f93-1adae16fbf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:06.237595 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1474/2942] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:59:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:59:06.391640 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:59:06.393038 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:06.484409 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddac914-3b27-4a0c-8abc-89a8b507c8e1 service neutron] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:59:06.489423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff119f2-cea0-48c0-8a62-094d7c383bd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:59:06.489992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff119f2-cea0-48c0-8a62-094d7c383bd7 service swift] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:06.490267 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff119f2-cea0-48c0-8a62-094d7c383bd7 service swift] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:06.490531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff119f2-cea0-48c0-8a62-094d7c383bd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:06.500013 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff119f2-cea0-48c0-8a62-094d7c383bd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:59:06.501613 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff119f2-cea0-48c0-8a62-094d7c383bd7 service swift] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:59:06.509687 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1469/2943] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:59:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:59:07.396565 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fed03-9ea8-4c1f-9f93-1adae16fbf65 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:59:07.419668 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5fed03-9ea8-4c1f-9f93-1adae16fbf65 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:59:07.428705 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2df0e5-de61-4907-9e6b-73195a125588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:59:07.429603 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2df0e5-de61-4907-9e6b-73195a125588 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:07.430025 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2df0e5-de61-4907-9e6b-73195a125588 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:07.430436 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2df0e5-de61-4907-9e6b-73195a125588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:07.433930 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-1c2df0e5-de61-4907-9e6b-73195a125588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:07.457981 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2df0e5-de61-4907-9e6b-73195a125588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:59:07.459085 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2df0e5-de61-4907-9e6b-73195a125588 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:59:07.495039 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1475/2944] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:59:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 10:59:16.506857 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=47 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:17.485525 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=93 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:18.025341 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d625a4-25ca-4838-aa33-5fa80d71cced None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:18.026399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d625a4-25ca-4838-aa33-5fa80d71cced None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:18.026399 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d625a4-25ca-4838-aa33-5fa80d71cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:18.046417 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-c4d625a4-25ca-4838-aa33-5fa80d71cced None None] MFA Rules not processed for user `db12327676224f3c994b28b761efadb8`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:59:18.047650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-c4d625a4-25ca-4838-aa33-5fa80d71cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:18.056302 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1470/2945] 10.222.0.49 () {58 vars in 958 bytes} [Fri Oct 28 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:59:18.839213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5cc2-8567-4335-b532-6ec13b72ddf1 None None] REQUEST_METHOD: `POST` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:18.840146 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5cc2-8567-4335-b532-6ec13b72ddf1 None None] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:18.840386 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5cc2-8567-4335-b532-6ec13b72ddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:18.852489 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d625a4-25ca-4838-aa33-5fa80d71cced None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:59:18.862121 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d625a4-25ca-4838-aa33-5fa80d71cced None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:59:18.867723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed8233-1a5e-4807-a05e-f5fe96153f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:59:18.868994 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8233-1a5e-4807-a05e-f5fe96153f16 service neutron] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:18.869266 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8233-1a5e-4807-a05e-f5fe96153f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:18.869532 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed8233-1a5e-4807-a05e-f5fe96153f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:18.871584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-8eed8233-1a5e-4807-a05e-f5fe96153f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:18.878917 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.auth.core [None req-7b0b5cc2-8567-4335-b532-6ec13b72ddf1 None None] MFA Rules not processed for user `832bcbcc10354e0d9484f76e77b7e09f`. Rule list: `[]` (Enabled: `True`). {{(pid=88565) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:59:18.880109 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-7b0b5cc2-8567-4335-b532-6ec13b72ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:18.885921 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed8233-1a5e-4807-a05e-f5fe96153f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:59:18.887425 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed8233-1a5e-4807-a05e-f5fe96153f16 service neutron] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:59:18.893890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1476/2946] 10.222.0.49 () {58 vars in 1058 bytes} [Fri Oct 28 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:59:18.900122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b5cc2-8567-4335-b532-6ec13b72ddf1 None None] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:59:18.905398 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1471/2947] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:59:18.917509 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b5cc2-8567-4335-b532-6ec13b72ddf1 None None] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:59:18.925827 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:59:18.926637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:18.927040 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:18.927404 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:18.930905 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:18.953074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:59:18.956361 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:59:18.967925 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1477/2948] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 10:59:22.061750 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e7f1-9c4f-4c81-8a94-b4741451cdba None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:22.062344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e7f1-9c4f-4c81-8a94-b4741451cdba None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:22.062344 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86e7f1-9c4f-4c81-8a94-b4741451cdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:22.085258 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ef86e7f1-9c4f-4c81-8a94-b4741451cdba None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 10:59:22.090706 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ef86e7f1-9c4f-4c81-8a94-b4741451cdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 10:59:22.094517 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1472/2949] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 10:59:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 10:59:22.109177 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 10:59:22.121628 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149eb861-c6ec-4dfe-ba9d-73b500c29ed1 service placement] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 10:59:22.127193 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 10:59:22.127797 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 10:59:22.128070 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 10:59:22.128334 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 10:59:22.137074 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 10:59:22.138655 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 10:59:22.148911 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1478/2950] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 10:59:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 10:59:32.077933 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=12 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:32.144194 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=19 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:17.501024 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf8b9-f4d5-4678-90fd-7467cfc9af70 None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:17.501546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf8b9-f4d5-4678-90fd-7467cfc9af70 None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:17.501546 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf8b9-f4d5-4678-90fd-7467cfc9af70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:17.521191 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-56acf8b9-f4d5-4678-90fd-7467cfc9af70 None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:01:17.522373 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-56acf8b9-f4d5-4678-90fd-7467cfc9af70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:17.529758 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1473/2951] 10.222.0.49 () {58 vars in 1009 bytes} [Fri Oct 28 11:01:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:01:17.571280 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:17.581546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275c43-1fca-47ce-badf-c9671a0c0dcb service swift] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:17.586536 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:17.587147 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:17.587421 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:17.587689 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:17.595770 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:17.597315 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:17.605955 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1479/2952] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 11:01:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:01:27.516318 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=3 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:27.602594 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=6 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:28.991773 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:28.992272 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:28.992383 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:29.012360 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:01:29.013607 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:29.020853 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1474/2953] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 11:01:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:01:29.033522 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:29.043825 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46958062-1fcf-4887-bdca-7b562887291f service swift] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:29.048907 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:29.049492 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:29.049765 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:29.050030 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:29.058549 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:29.060122 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:29.068157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1480/2954] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 11:01:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:01:30.878144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:30.878144 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:30.894212 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30942-32ec-46dc-8d7c-71aa6bf768fa None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:30.900629 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5add4-2371-498c-8926-35faab6c7beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:30.901498 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5add4-2371-498c-8926-35faab6c7beb service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:30.902637 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5add4-2371-498c-8926-35faab6c7beb service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:30.903156 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5add4-2371-498c-8926-35faab6c7beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:30.905262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-fbb5add4-2371-498c-8926-35faab6c7beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:30.919334 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5add4-2371-498c-8926-35faab6c7beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:30.921194 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5add4-2371-498c-8926-35faab6c7beb service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:30.933183 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1475/2955] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 11:01:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:01:33.715562 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:33.729460 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd85f9-a655-4c01-852b-b0c0ac9eacb8 service swift] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:33.734868 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:33.735465 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:33.735741 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:33.736011 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:33.737732 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:33.749546 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:33.751300 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:33.761697 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1481/2956] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 11:01:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:01:35.910136 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1c13-31e1-4424-812b-355b08ec8a4a None None] REQUEST_METHOD: `POST` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:35.910651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1c13-31e1-4424-812b-355b08ec8a4a None None] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:35.910651 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a1c13-31e1-4424-812b-355b08ec8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:35.931031 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.auth.core [None req-ac3a1c13-31e1-4424-812b-355b08ec8a4a None None] MFA Rules not processed for user `3c1c66c9a43b41e89551ad02466a691e`. Rule list: `[]` (Enabled: `True`). {{(pid=88564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 11:01:35.932227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-ac3a1c13-31e1-4424-812b-355b08ec8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:35.939650 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1476/2957] 10.222.0.49 () {58 vars in 967 bytes} [Fri Oct 28 11:01:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 11:01:35.952504 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:35.963388 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b9c0f-adca-44b1-abb3-ec37ab266bc0 service nova] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:35.968351 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23992d468c5c427f9cac898359ee569a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:35.968937 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:35.969213 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:35.969479 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:35.977687 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:35.979285 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:35.987384 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1482/2958] 10.222.0.49 () {60 vars in 1384 bytes} [Fri Oct 28 11:01:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 11:01:39.637225 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1c13-31e1-4424-812b-355b08ec8a4a None None] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:39.650281 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a1c13-31e1-4424-812b-355b08ec8a4a None None] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:39.655712 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47f38d07f1c44175af29a9dfe93f0f37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:39.656306 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:39.656579 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:39.656842 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:39.665331 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:39.667133 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:39.676182 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1477/2959] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 11:01:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:01:43.460018 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:43.469140 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ec069-b121-4f71-92f3-b6411fec7447 service swift] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:43.472670 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6623b72a17b4f4493e675a344251f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:43.473246 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:43.473519 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:43.473788 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:43.534523 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:43.541613 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:43.545731 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1483/2960] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 11:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:01:46.841793 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:46.853423 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8957036-b4cb-4e54-a2e0-44fa9103c7a6 service nova] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:46.859273 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:46.859893 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:46.860173 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:46.860445 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:46.862262 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:46.879062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:46.879062 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:46.887903 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1478/2961] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 11:01:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:01:50.931248 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:50.941614 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0cc334-b615-49f3-a418-27268548ed7c service neutron] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:50.946730 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:50.947357 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:50.947631 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:50.947898 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] PATH_INFO: `/v3/users/db12327676224f3c994b28b761efadb8` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:50.949152 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db12327676224f3c994b28b761efadb8)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:50.951157 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:51.119390 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db12327676224f3c994b28b761efadb8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.191637 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db12327676224f3c994b28b761efadb8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.192373 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db12327676224f3c994b28b761efadb8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.200991 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db12327676224f3c994b28b761efadb8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.214321 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db12327676224f3c994b28b761efadb8'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.220183 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1484/2962] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 11:01:50 2022] DELETE /identity/v3/users/db12327676224f3c994b28b761efadb8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 11:01:51.460001 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:51.472573 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4bc8-dfb6-4de1-a0d7-6a05fca19fd2 service placement] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:51.535531 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:51.536155 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:51.536429 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:51.536723 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] PATH_INFO: `/v3/projects/77ccbcc7981f482d893fefbb3bbd899c` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:51.537816 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ccbcc7981f482d893fefbb3bbd899c)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:51.539775 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:51.629282 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ccbcc7981f482d893fefbb3bbd899c', 'request_id': 'req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.677227 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ccbcc7981f482d893fefbb3bbd899c', 'request_id': 'req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.683708 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ccbcc7981f482d893fefbb3bbd899c', 'request_id': 'req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.696578 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] The token cache is being invalidate because project 77ccbcc7981f482d893fefbb3bbd899c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:01:51.696870 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.697520 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:51.699093 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1479/2963] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 11:01:51 2022] DELETE /identity/v3/projects/77ccbcc7981f482d893fefbb3bbd899c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:01:51.703144 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:51.704517 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:51.717293 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ff08-59b6-4706-a3a9-b347ee927ca0 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:51.741639 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:51.774188 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:51.774856 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:51.775134 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:51.775403 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] PATH_INFO: `/v3/users/8a46a1c13f71473a93b5596c95024519` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:51.776544 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a46a1c13f71473a93b5596c95024519)` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:51.778452 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:51.977692 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a46a1c13f71473a93b5596c95024519'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.054650 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a46a1c13f71473a93b5596c95024519'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.055268 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a46a1c13f71473a93b5596c95024519'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.062775 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a46a1c13f71473a93b5596c95024519'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.075772 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.notifications [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a46a1c13f71473a93b5596c95024519'} {{(pid=88565) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.081890 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1485/2964] 10.222.0.49 () {58 vars in 1224 bytes} [Fri Oct 28 11:01:51 2022] DELETE /identity/v3/users/8a46a1c13f71473a93b5596c95024519 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:01:52.327992 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:01:52.329583 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:01:52.344645 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f821-ae70-4b64-aadd-c0570fb3c2bb admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:01:52.379195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:52.401691 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcd63f0bb4e43ce8c0c41898fafca96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '713caf85a4104b85af4a0b40b1b96328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:01:52.402313 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:01:52.402584 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:01:52.402883 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] PATH_INFO: `/v3/projects/d27451c5d12d4b698be6e4aba33b9ab4` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:01:52.403978 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27451c5d12d4b698be6e4aba33b9ab4)` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:01:52.405866 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:01:52.494764 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27451c5d12d4b698be6e4aba33b9ab4', 'request_id': 'req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.557515 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27451c5d12d4b698be6e4aba33b9ab4', 'request_id': 'req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.565047 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27451c5d12d4b698be6e4aba33b9ab4', 'request_id': 'req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69'} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.576884 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] The token cache is being invalidate because project d27451c5d12d4b698be6e4aba33b9ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 11:01:52.577102 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.577745 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.notifications [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 11:01:52.579263 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1480/2965] 10.222.0.49 () {58 vars in 1233 bytes} [Fri Oct 28 11:01:52 2022] DELETE /identity/v3/projects/d27451c5d12d4b698be6e4aba33b9ab4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 11:02:02.078372 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:02:02.573928 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:02:02.820667 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Authenticating user token {{(pid=88565) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:02:02.822110 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:02:02.891531 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd8a10-0c7e-4148-80ea-9d6bc9180dc3 admin admin] Validating token access rules against request {{(pid=88565) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:02:02.953867 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33db6e3-df48-4a6a-8c3b-a51fe88122b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88565) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:02:02.954498 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33db6e3-df48-4a6a-8c3b-a51fe88122b0 service placement] REQUEST_METHOD: `GET` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:02:02.954805 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33db6e3-df48-4a6a-8c3b-a51fe88122b0 service placement] SCRIPT_NAME: `/identity` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:02:02.955073 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33db6e3-df48-4a6a-8c3b-a51fe88122b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88565) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:02:02.956811 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.fernet_utils [None req-f33db6e3-df48-4a6a-8c3b-a51fe88122b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88565) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:02:02.968824 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33db6e3-df48-4a6a-8c3b-a51fe88122b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:02:02.973681 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33db6e3-df48-4a6a-8c3b-a51fe88122b0 service placement] RBAC: Authorization granted {{(pid=88565) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:02:02.981259 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: [pid: 88565|app: 0|req: 1486/2966] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 11:02:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:02:12.977164 dv-neutron-zed-2-hyperv devstack@keystone.service[88565]: DEBUG dbcounter [-] [88565] Writing DB stats keystone:SELECT=58 {{(pid=88565) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:07.729139 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Authenticating user token {{(pid=88564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 11:07:07.730563 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.fernet_utils [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 11:07:07.819925 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86a3d-fb8b-4401-ab96-bdc772aa6b69 admin admin] Validating token access rules against request {{(pid=88564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 11:07:07.825195 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142feeeb-23d2-49bb-b18f-f6e936475a19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '832bcbcc10354e0d9484f76e77b7e09f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c31a9818f5d646fe822d32d25199dae1', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 11:07:07.825787 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142feeeb-23d2-49bb-b18f-f6e936475a19 service placement] REQUEST_METHOD: `GET` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 11:07:07.826060 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142feeeb-23d2-49bb-b18f-f6e936475a19 service placement] SCRIPT_NAME: `/identity` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 11:07:07.826326 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142feeeb-23d2-49bb-b18f-f6e936475a19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 11:07:07.834781 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142feeeb-23d2-49bb-b18f-f6e936475a19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 11:07:07.836366 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142feeeb-23d2-49bb-b18f-f6e936475a19 service placement] RBAC: Authorization granted {{(pid=88564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 11:07:07.845843 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: [pid: 88564|app: 0|req: 1481/2967] 10.222.0.49 () {60 vars in 1365 bytes} [Fri Oct 28 11:07:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 11:07:17.841890 dv-neutron-zed-2-hyperv devstack@keystone.service[88564]: DEBUG dbcounter [-] [88564] Writing DB stats keystone:SELECT=37 {{(pid=88564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}